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PEEFACE TO THE FIRST EDITION 


Applied mathematics comes down ultimately to numerical results, and 
the student of any branch of applied mathematics will do well to supple- 
ment his usual mathematical equipment with a definite knowledge of the 
numerical side of mathematical analysis. He should, in particular, be able 
to estimate the reliability of any numerical result he may arrive at. The 
object of this book is to set forth in a systematic manner and as clearly as 
possible the most important principles, methods, and processes used for 
obtaining numerical results; and also methods and means for estimating 
the accuracy of such results. The book is concerned only with fundamental 
principles and processes, and is not a treatise on computation. For this 
reason little attention is paid to computation forms, the assumption being 
that the reader who has much computation of a particular kind to do will 
be able to devise his own form. 

The plan of treatment followed throughout the book may be briefly 
stated as follows: Each major subject or topic is introduced by a short 
statement of “ what it is all about.” Then follows a brief statement of the 
underlying theory of the subject under consideration. With this theory 
as a basis, the processes and formulas are then developed in the simplest 
and most direct manner. Formulas and methods for checking or esti- 
mating the accuracy of results are also worked out wherever possible. The 
reader is then shown just how to use the formulas and processes developed, 
by applying them to a variety of e.xamples. Finally, the limitations of the 
formulas and the pitfalls connected with the processes are carefully pointed 
out by means of appropriate examples. Notes and remarks are also added 
wherever they will throw further light on the subjects under consideration. 

The treatment of all topics has been made as elementary as was con- 
sistent with soundness, and in some instances the explanations may seem 
unnecessarily detailed. For such detailed explanations no apology is 
offered, as the book is meant to be understood with a minimum of effort 
on the part of the reader. Moreover, experience in teaching certain topics 
has shown that even a good student must receive considerable assistance 
from teacher, textbook, or some other source. I have tried everywhere to 
clear up the difficulties before the student meets them, so that no teacher 
or other source of information will be needed. In order to make the book 
everywhere as readable as possible I have purposely refrained from using 
notations peculiar to certain subjects, and from employing symbolic methods 
and divided differences in deriving the standard formulas of interpolation. 

vii 



PREFACE TO THE FIRST EDITION 


A knowledge of calculus to the extent of the usual first course is all that 
IS needed for the understanding of anything m the hook 

The more important formulas throu^out the book are numbered in 
heavy black type to distinguish them from those of less importance 

The worker who is to ob&m numerical results with a minimum of 
effort must provide himself with every possible aid for lessening the labor 
of his task In addition to snch aids as slide rules, computing machines, 
and logarithmic tables, the computer will find that Barlow’s tables of 
squares, cubes, etc, and the Smithsonian Mathematical Tables are prse* 
ticaliy indispensable Crelle’a “ Calcnlating Tables,” Jahnke and Emde’s 
“ Funktionentafeln," and Jordan’s “Opus Palatinum” (tables of natural 
Bines and cosines to seven decimal places) will also prove their worth in 
many instances 

In the preparation of the book I have consulted the writings of the 
majority of previous writers on the subjects treated, and am indebted to 
many of them for ideas and methods, but my greatest debt is to the 
writings of the late and great Carl Rungc, who undoubtedly contributed 
more to numerical mathematical analysis than any other man since Gauss 
References to the works of other writers will be found here and there m 
the text and m footnotes 

It IS s pleasnre to record my thanks to the U S Naval Institute for 
permission to use certain copyrighted material which I originally prepared 
for Engineering ilathematiet 1926), to Dr L. M Sells, of the 

U S Naval Academy, for helpful criticism on parts of the manuscript, 
and to the Johns Hopkins Press and the George Banta Publishing Company 
for their hearty cooperation in meeting my wishes concerning the make np 
and publication of the book 

J B SOASBOBOUOH 

Annapolu, ild 
Eovemltr, 19S0 



PEEFACE TO THE SECOND EDITION 

In this revision all known errors and misprints in the first edition have 
been corrected. A considerable amount of new material has been added, 
and a small amount of material in the previous edition has been left out. 

The chapter on numerical integration in the original edition has been 
rewritten and augmented to a considerable extent. All the material dealing 
with the numerical solution of ordinary differential equations has been 
completely recast and augmented in various directions. Much more atten- 
tion has been given to methods of starting the solutions, and all the best 
methods for that purpose have been treated in detail. 

The major part of the new material consists of a section on the accuracy 
of the solutions of systems of linear equations, the new material dealing 
with numerical integration, the new material dealing with the numerical 
solution of ordinary differential equations, including the derivation of the 
equations of exterior ballistics, a rather lengthy chapter on the numerical 
solution of partial differential equations, and a shorter chapter on the 
numerical solution of integral equations. Other new material in smaller 
amounts has been added in various places. 

In all new material, as well as in the old, an effort has been made to 
make the treatment unmistakably clear and understandable everywhere 
and in all respects. Although the utmost clarity was aimed at in the first 
edition, clarity has received even more attention in this revision. 

The exercises at the ends of the chapters have been changed and aug- 
mented to some extent, and the answers to the majority of them are given. 

During the past fifteen years the computer has been provided with great 
and revolutionary aids. The many volumes of W. P. A. Tables, sponsored 
by the National Bureau of Standards, have met a real need of long 
standing; the great automatic calculating machines have performed with 
ease and rapidity many calculations that were prohibitive in labor and time 
by the older hand methods and hand machines, and they have turned out 
volumes of tables in a matter of weeks ; and, finally, the important journal 
Mathematical Tables and Other Aids to Commutation serves as a clearing 
house in matters of computation and enables the computer to keep up 
with progress in computation throughout the world. The computer wiU 
be wise to make use of these aids whenever possible. It seems no exaggera- 
tion to say that during no other fifteen-year period in the world’s history 
have such great strides been made in the art of getting numerical results. 
May the strides continue ! 

I wish here to thank those readers in various parts of the world who 

iz 



PREFACE TO THE BECOHD EDITION 


haTe kindly pointed ont errors and nuspnnts in the first edition of this 
work. I shall be grateful to futnre readers who may notify me of errors 
or misprints m the present edition 

It IS a pleasure to record my thanks to Professors A E Currier and 
S S Saslaw for putting at my disposal their unusual knowledge of mathe 
matical analysis and to Professor J M Holme for his excellent work in 
drawing the figures m their final form 

Finally, I wish to extend my thanks to the Johns Hopkins Press and 
the J H Furst Company for their hearty cooperation in meetmg my 
wishes relative to the make up of the book 

J B SCABBOBOCOH 

August 1950 


PREFACE TO THE THIRD EDITION 

This edition is mostly an enlargement of the previous edition The sew 
material consists mainly of an article on the errors in determinanU and 
a chapter on the numerical solution of simultaneous linear equations 
All known misprints and errors m the second edition hare been corrected 
and a few other minor improvements have been made 
In recent years the numerical eolation of systems of linear ei^uations 
has become a subject of mayor importance due mainily to the widespread 
use of automatic computing machines In the new chapter of this book 
several of the best methods of solving such equations ha>e been treated 
m detail and illustrated by numerical examples An attempt has been 
made to make the treatment as clear and direct as possible 

Here I wish to record my thanks and indebtedness to Dr Morns N'ewman, 
of the National Bureau of Standards for bringing to mv attention the 
method of inverting matrices osed at the Bureau of Standards and for 
explaining certain points connected with the method I also wish to 
all readers who have kindly bronght to my attention some of the errors 
and misprints in the second edition 
Finally I wish to record my thanks to the Director of the Johns Hopkins 
Press for his interest encouragement and cooperation m bringing out 
this edition 


Sepitinber 1955 


J B S 



PREFACE TO FOURTH EDITION 

PREFACE TO THE FOURTH EDITION 

In preparing this edition I have made major changes and additions in 
Chapters X, XI, and XVI of the third edition and have also made minor 
changes and additions in other parts of that edition. 

An article on the convergence of the Newton-Eaphson method has been 
added in Chapter IX. In Chapter X, Brodetsky and Smeal’s perfection 
of Graeffe’s method has been explained in detail, somewhat simplified and 
modified, and illustrated by two worked examples. An article on improving 
the accuracy of complex roots found by the Graeffe method has also been 
added. 

A few important changes and additions have been made in Chapter XI. 
In Chapter XVI a section on smoothing experimental data has been added, 
with illustrative examples and exercises. 

All knovra misprints and errors in the third edition have been corrected. 


March, 1958 


J. B. S. 


PREFACE TO THE FIFTH EDITION 

In this edition the material of the fourth edition has been augmented 
by the addition of new material and rearranged in places to improve logical 
order. The most important additions are a chapter on interpolation with 
unequal intervals of the argument by means of Newton’s general formula 
of interpolation, the derivation of all central-difference interpolation for- 
mulas by means of divided differences, and methods of investigating the 
errors in the solutions of single equations and systems of linear equations 
when the coefficients are subject to errors. Several minor additions and 
changes have also been made. 

Some of the exercises in the fourth edition have been changed and new 
ones added. Answers are given to all exercises except those on differential 
equations. All known errors and misprints in the fourth edition have been 
corrected. 


November, 1961 


J.B. S. 
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NUMERICAL MATHEMATICAL 
ANALYSIS 


CHAPTER I 

THE ACCURACY OF APPROXIMATE CALCULATIONS 

1. Introduction. Since applied mathematics comes down ultimately to 
numerical results, the worker in applied mathematics will encounter all 
kinds of numbers and all kinds of formulas. He must be able to use the 
numbers and evaluate the formulas so .as to get the best possible result in 
any situation. What he learned about numerical calculation in his earlier 
study of arithmetic is inadequate for handling the numerical side of applied 
mathematics. For e.xample, the numerical data used in solving the prob- 
lems of everyday life are usually not exact, and the numbers expressing 
such data are therefore not exact. They are merely approximations, true 
to two, three, or more figures. 

Not only are the data of practical problems usually approximate, but 
sometimes the methods and processes by which the desired result is to 
be found are also approximate. An approximate calculation is one which 
involves approximate data, approximate methods, or both. 

It is therefore evident that the error in a computed result may be due 
to one or both of two sources : errors in the data and errors of calculation. 
Errors of the first type cannot be remedied, but tliose of the second type 
can usually be made as small as w'e please. Thus, when such a number as 
IT is replaced by its approximate value in a computation, we can decrease 
the error due to the approximation by taking r- to as many figures as 
desired, and similarly in most other cases. We sliall therefore assume in 
this chapter that the calculations are always carried out in such a manner 
as to make the errors of calculation negligible. 

Nearly all numerical calculations are in some way approximate, and the 
aim of the computer should be to obtain results consistent with the data 
with a minimum of labor. The object of the present chapter is to set 
forth some basic ideas and methods relating to approximate calculations 
and to give methods for estimating the accuracy of the results obtained. 
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2 Approximate Numbers and Significant Figures. 

(a) /Ipproiima/e i^umjers In the discussion of approximate compu 
tatioii it IS convenient to make a distinction between numbers which are 
absoluielj exact and those which express approximate values Such 
numbers as 2, 1/3, 100, etc are exact numbera because there is no approxi- 
mation or uncertainty associated with them Although such numbers as 
r, y/z, e, etc are exact numbers, they cannot be expressed exactly by a 
finite number of digits When expressed in digital form, they must he 
written as 3 1416, 1 4142, 2 7183, etc. Such numbers are therefore only 
approximations to the true values and in such esses are called approximate 
numbers An approximate number is therefore defined as a number which 
IS used as an approximation to an exact number and differs only slightly 
from the exact number for which it stands • 

(b) S\gn\ficanl Fsgurts A stpnt/kant figure is any one of the digits 

1,2,3, 9, and 0 is a significant figure except when it is used to fix 

the decimal point or to fill the places of unknown or discarded digits 
Thus in the number 0 00263 the significant figures are 2, 6, 3, the reros 
are used merely to fix the decimal point and are therefore not signifiiAoi 
In the number 3809, however, all the digits, including the zero, are sigsifi 
cant figures In a number like 46300 there is nothing is the number as 
written to show whether or not the zeros are significant figures The 
ambiguity can be removed by writing the number in the powers^of ten 
notation as 4 63 X10‘, 4 630X10*. or 4 6300 X 10*, the number of 
significant figures being indicated by the factor at the left 

3 Rounding of Numbers. If we attempt to divide 2? by 13 1, we get 

27/13 1 — 2 061068702 , 

a quotient which never terminates In order to use such a number m a 
practical computation, we must cut it down to a manageable form, such 
as 2 06, or 2 061, or 2 06107, etc This process of cutting off superSnous 
digits and retaining as many as desired is called rounding off 

To round off or simply round a number is to retain a certam number 
of digits, counted from the left, and drop the others Thus, to round off r 
to three, four, five, and six figures, respectively, we have 3 14, 3 142, 
3 1416, 3 14159 Numbers are rounded off so as to cause the least poss%ble 
error This is attained by rounding according to the following rule 

• &BW oncAfn- iiM^-oAiecV to lAe itra ^approiiteafe nutaSer ' »B<f fiufil that oaa 
atkould always say approximaU value of a number The iborter tena, however, 
la leaa cumbroua la perfectly deflnite at deBned above and remlnda ua by iU veiy 
name that it aUnda for the approximate value of a number It hat been need In 
thU aeua by no lata an authority than Jnlea Tannery In hla Lteona d‘Arlt>nn4tiqm 
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To round off a number to n significant figures, discard all digits to the 
right of the nth place. If the discarded number is less than half a unit 
in the nth place, leave the nth digit unchanged; if the discarded number 
is greater than half a unit in the nth place, add 1 to the nth digit. If 
the discarded number is exactly half a unit in the nth place, leave the nth 
digit unaltered if it is an even number, but increase it by 1 if it is an 
odd number; in other words, round off so as to leave the nth digit an 
even number in such cases. 

When a number has been rounded off according to the rule just stated, 
it is said to be correct to n significant figures. 

The following numbers are rounded off correctly to four significant 
figures : 


29.63243 

becomes 29.63 

81.9773 

€t 

81.98 

4.4995001 

€< 

4.500 

11.64489 

€t 

11.64 

48.365 

€< 

48.36 

67.495 

<C 

67.50 


When the above rule is followed consistently, the errors due to rounding 
are largely cancelled by one another. 

Such is not the case, however, if the computer follows an old rule which 
is sometimes advocated. The old rule says that when a 5 is dropped the 
preceding digit should always be increased by 1. This is bad advice and 
is conducive to an accumulation of rounding errors and therefore to 
inaccuracy in computation. It should be obvious to any thinking person 
that when a 5 is cut off, the preceding digit should be increased by 1 in 
only half the cases and should be left unchanged in the other half. Since 
even and odd digits occur with equal frequency, on the average, the rule 
that the odd digits be increased by 1 when a 6 is dropped is logically sound. 

The case where the number to be discarded is exactly half a unit in the 
nth place deserves further comment. From purely logical considerations 
the digit preceding the discarded 5000 • • ■ might just as well be left odd, 
but there is a practical aspect to the matter. Hounded numbers must often 
be divided by other numbers, and it is highly desirable from the stand- 
point of accuracy that the division 'be exact as often as possible. An even 
number is always divisible by 2, it may be divisible by other even numbers, 
and it may also be divisible by several odd numbers; whereas an odd 
number is not divisible by any even number and it may not be divisible by 
any odd number. Hence, in general, even numbers are exactly divisible 
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by many more numbers than are odd numbers, and therefore there will 
be fewer left-orer errors in a computation when the rounded numbers are 
left eren The rule that the last digit be left even rather than odd is 
thus conducire to accuracy in computation 

In certain rare instances the role for cutting off 50000 should be 
modified For example, if a 6 a to be cut off from two or more numbers 
in a column that is to he added, the preceding digit should be increased 
by I in Afll/ the cases and left unchanged m the other half, regardless of 
whether the preceding digit is eren or odd Other cases might arise 
where common sense should be the guide in making the errors neutralize 
one another 

4 Absolute, Relative, and Percentage Errors The absolute error of 
a number, measurement, or calculation is the numerical difference between 
the true value of the quantity and ita approximate value as given, or 
obtained by measurement or calculation The relaUve error is the absolute 
error divided by the true value of the quantity The percentage error is 
100 times the refative error Pot exsmpfe, fet i? represent the true vafue 
of some quantity If aQ is the absolute error of an approximate value 
of Q, then 

tQ/Q •m relative error of the approximate quantity 
IOOaQ/Q — percentage error of the approximate quantity 
r 

If a number is correct to n significant figures, it is evident that its 
absolute error can not be greater than half a unit in the nth place For 
example, if the number 4 629 is correct to four figures, its absolute error 
18 not greater than 0001 X }~O0Q05 

r Remark It is to be noted that relative and percentage errors are 
I independent of the unit of measurement, whereas absolute errors are 
'^pressed in terms of the unit used 

5 Relation between Relative Error and the Number of Significant 
Figures The belief is widespread, even in scientific circles, that the 
accuracy of a measurement or of a computed result is indicated by the 
number of decimals required to express it This belief is erroneous, for 
the accuracy of a result is indicated by the number of stgnipcant figwes 
required to express it The true index of the accuracy of a mcasuremenf^ 
or of a calculation is the relative error For example, if the diameter of 

a 2 inch steel shaft is measured to the nearest thousandth of an inch the 
result is less accurate than the measurement of a nnle of railroad track 
to the nearest foot For although the absolute errors m the two measure 
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ments are 0.0005 inch and 6 inches, respectively, the relative errors are 
0.0005/2 = 1/4000 and 1/10,560. Hence in the measurement of the shaft 
we make an error of one part in 4000, whereas in the case of the railroad 
we make an error of one part in 10,560. The latter measurement is clearly 
the more accurate, even though its absolute error is 12,000 times as great. 

The relation between the relative error and the number of correct figures 
is given by the following fundamental theorem: 

Theorem I. If the first significant figure of a number is k, and the 
number is correct to n significant figures, then the relative error is less 
than l/(k X lO"'"). 

Before giving a literal proof of this theorem we shall first show that it 
holds for several numbers picked at random. Henceforth we shall denote 
absolute and relative errors of numbers by the symbols Ea and Er, 
respectively. 

Example 1. Let us suppose that the number 864.32 is correct to five 
significant figures. Then i = 8, n = 5, and Ea ^ 0.01 X i = 0.005. For 
the relative error we have 

„ ^ 0.005 5 1 

= 864.32— 0.005 864320 — 5 ~ 2 X 86432 — 1 

^ 1 

2(86432 — ^) ^2 X 8 X 10‘ ^8 X 10* ’ 

Hence the theorem holds here. 

Example 8. Next, let us consider the number 369,230. Assuming that 
the last digit (the zero) is written merely to fill the place of a discarded 
digit and is therefore not a significant figure, we have fc = 3, n = 6 and 
Ea^lQXi^b. Then- 

® ^ 1 — 1 

- 369230 — 5 2 X.36923 — 1 2(36923 — |) 

< I <_J 

^2X3X10* ^3X10* 

Example S. Finally, suppose the number 0.0800 is correct to three 

significant figures. Then fc = 8, n = 3, ^ 0.0001 X i -= 0.00005, and 

^ ^ 0.00005 5 1 

’’ 0.0800 — 0.00005 8000 — 5 1600 1 

1 1 
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It IS to be noted that in this eianipU the relative error la not certainly 
lesB than 1/(2*? X lO*"');. “ case la Examples 1 and 2 above 

To prove the theorem generally, let 

N — any number (exact value), 
n ^ number of correct significant figures, 
m •- number of correct decimal places 

Three cases must be distinguished, namely m < n, m n, and rn > n 

Case 1 m < n Here the number of digits m tha integral part of N 
IS ft — fit Denoting the first significant figure of if by it, as before, vre 
have 

E, g 1/10* X i. if § I X 10^ ‘ — 1/10- X 1 

Hence 

p ^ 1/10* X \ 10:^ 

^ k X 10*^ ‘ — 1/10« X 4 2k X 10-‘ X 10- — 10 - 
1 _ 1 
”2fcX10-‘ — 1 2(feX10*-‘ — i) 

Bememhenog nov that n is a postltve tnteysr and that k stands (or anv 
one of the digits from 1 to 9 inclBSire, -we readily eee that 2k X 10*~* — Z 
> k X 10* ‘ in all cases except fc — 1 and n — ■ 1 But this u the tnnal 
case where JT 1, 0 01, etc , that le, where if contains only one digit 
different from lero and this digit is 1— a case which would never occur 
in practice Hence for all other cases we have 2t X lO*"* — 1 > fc X 10« * 
and therefore 




fcxio« 


Case S m^n Here if is a decimal and k is the first decimal figure 
We then have 


■Erg 


E.gl/lO-Xi Jf^iXlO-* — 1/10-Xi 

10 "X 4 10- 

iX10-‘— 10— Xi 2kX10-‘ — 10- “sTx 
1 I 


21; X 10* ‘ — 1 ^ fc X 10* ‘ 

Case S m > n In this case k occupies the (m — n + l)th decimal 
place and therefore 
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N^hX — 1/10"* xh -2^0 ^ 1/10” X i 


10 ^;;; 

2fc X 10-” X 10"-' — 10-"* 


The theorem is therefore true in all cases. 

Corollary 2. Except in the case of approximate numbers of the form 
fc (1.000- ■ •)X lOP, in which k is the only digit different from zero, the 
relative error is less than l/(ik X 10"'*). 

Corollary 2. If i ^ 6 and the given approximate number is not of the 
form fc(1.000 • • OX 10^, then Bf < I/IO"; for in this case Zk ^ 10 and 
therefore 2k X 10"”^ ^ 10". 

To find the number of correct figures corresponding to a given relative 
error we can not take the converse of the theorem stated at the beginning 
of this article, for the converse theorem is not true. In proving the 
formula for the relative error we took the lower limit for N in order to 
obtain the upper limit for Br. Thus, for the lower limit of B we took 
its first significant figure multiplied by a power of 10. In the converse 
problem of finding the number of correct figures corresponding to a given 
relative error we must find the upper limit of the absolute error Ec) 
and since Ea = NEr, we should use the upper limit for N. This upper 
limit will be k + 1 times a power of 10, where k is the first significant 
figure in N. For example, if the approximate value of N is 6895, the 
lower limit to be used in finding the relative error is 6 X 10®, whereas the 
upper limit to be used in finding the absolute error is 7 X 10®. 

To solve the converse problem we utilize Theorem II: 

Theorem II. If the relative error in an approximate number is less 
than l/[(k+ 1) X lO"-*], the number is correct to n significant figures 
or at least is in error by less than a unit in the nth significant figure. 

To prove this theorem let 




10-"* X i 


k X 10"" X 10"*^ ~ 10-" X i 

1 .1 


2k X 10"- 


< 


k X 10"'" 


JV-=the given number (exact value), 
n «=» number of correct significant figures in N, 
k first significant figure in N, 
p ■= number of digits in the integral part of N 

Then 


n- p •=» number of decimals in N, 
and A" g (^ -f. 1) X lO^-h 
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Let 

(t+l)X10*‘ 

Then 

No» l/30’*-» w one unit jn the (n — ;r)lh decimal place, or m the nth 
significant figure Renee the ahsolute error » less than a unit m the 
nth significant figure 

If the given number is a pure decimal, let 

number of zeros behreen the decimal point and first significant 
figure Then n + P number of decimals in E, and 


Eence if 


we have 




(fc + 1) 

XOv* 


E,< 


1 


P L- 

20^. (Jr + l)X 10* ' 30»*F 


But 18 one unit in the {ft + p)th decimal place, or in the nth 

significant figure Hence the absolute error E, is less than a unit m the 
nth significant figure 

Corollary S li £,< l/[2(fc + 1)X 10*"*], then E, is less than half 
a omt in the nth significant figure and the given cumber is correct to n 
significant figures in all cases 

Corollary 4 Since 1 may have any value from 1 to 9 inclusive, it is 
evident that i + 1 may have any value from 2 to 10 Hence the npper 
and lower limits of the fraction l/(2(fc + 1)X 10" *] are 1/(4 X 10""*) 
and 1/(2 X 10")> respectively We can therefore assert that 


If the relaUvi error of any number « not yreater tfton 1/(2 X 10") the 
number ts certatniy correct to n styntfiaint figures 

y 1 Remarlc The reader can icadilv see from the preceding discussion that 
jthe obsolute error is connected with the number of ieetmal places, whereas 
(tte relative error is connected with the number of stymficant figures 
6 The General Formula for Errors Let 
(1) E =^f{uun2,Ui, u,) 
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denote any function of several independent quantities u^, ih, - ■ ' which 
are subject to the errors AUi, Auj, ‘ respectively. These errors^ in 

the n’s will cause an error AN in the function N, according to the relation 

(2) N AN = /(«i + AUt, Vz + ■ ■ ■ Wn + Au„) . 

To find an expression for AN we must expand the right-hand member 
of (2) by Taylor’s theorem for a function of several variables. Hence 
we have 

Sf 

Ihn -f A«„) = /(«1, Uz,- • -Un) + A«1 - 


f{ui -f AWj, Uz -}- AUz, ■ 


4- AU; 


dUz 


+ ■ 


dUi 


CMn‘ 


4- ZAUiAUz 


d^f 


4 - • • •] + • • • - 


duiduz 

How since the errors Awj, Auz, • • • Au„ are always relatively small,* we 
may neglect their squares, products, and higher powers and write 

(3) H 4- AJV = f{Ui,Uz, Us, • • • «Tv) 

4-A«,7^ 4-Au2^ 4-- • •4-A«„^ 

fUi 0U2 SUn 


Subtracting (1) from (3), we get 


AN =-^ Aui 4- ^ AUz 4- • 


I 9/ A 


or 

( 6 . 1 ) 


aA7 a . 22V ^ . dN ^ , , 0iV 

“ 0Us + 0^7 + • • • + 3^ A«„. 


This is the general formula for computing the error of a function, and 
it includes all possible cases. It will be observed that the right-hand 
member of (6. 1) is merely the total differential of the function N, 

For the relative error of the function N we have 




dN Aui dN AUz 
dui N 3u2 N 


( 6 . 2 ) 

"When N is a function of the form 

Ea”h”cP 


0H Au„ 

3«„'ir 


(6.3) 


N- 


dvg'- 


• A quantity P is said to be relatively small in comparison with a second quantity 
Q when the ratio P/Q is small in comparison with unity. The squares and products 
of such small ratios ars negligible in most calculations. 
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then by (6 2) the relatire error is 

Er — AA'/iV' — m (Aa/o) + «(Ab/J) + — q(Ad/d) — r(A#/s) 

But eiDce the errors Aa, Ae, etc are just u likely to be negatire as 
positire, we must take all the terms with the positire sign in order to be 
sure ot the maiimuin error id the fnaction N Hence we write 
(6 4) g m I Ao/a \ + n\ Ab/b | + p | Ae/c \+q\ Ad/i | + r | Ae/s 1 

7 Application of the Error Formulas to the Fundamental Operations 
of Ant^etie and to Logarithms. We shall now apply the preceding 
results to the fundamental operations of arithmetic 
7a) AdditxoTL Let 

— «! + «*+ +w« 

Then 

(7 1) Al^ — — Att, + A«,+ +AU, 

The absolute error of a sum of approximate namben u therefore equal to 
the algebraic sum of their absolute ettort 
The proper way to add approximate numbers of different accuracies u 
shown in the two examples below 

Example I Find the sum of the approximate numbers 661 32, 491 6, 
86 9S4, and 2 9i62, each being correct to lia last figure but no farther 
ffolufton. Since the eecoud number le known only to the first decimal 
place it would be useless and absurd to retain more than two decimals 
m any of the other numbers Bence we round them off to two decimals, 
add the four numbers, and give the result to one decimal place, as shown 
below 

4916 
661 32 
66 95 
3W 


11436 

By retaining two decimals in the more accurate numbers we eliminate 
the errors inherent m these numbers and thus reduce the error of the sum 
to ilut iesst atvcffwto iraBriar IBe iJintf resfij^ fiowerer, a uncertain 

by one unit m its last figure 

Example £ Find the sum of 36490, 994, 667 32, 29600, and 86939, 
Bssummg that the number 29500 is known to only three significant figures 
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Solution. Since one of the nunibers is known only to the nearest hundred, 
we round off the others to the nearest ten, add, and give the sum to hun- 
dreds, as shown below: 

29500 

86940 

36490 

990 

560 


154500 or 1.545 X 10®. 

The result is uncertain by one unit in the last significant figure. 

In general, if we find the sum of m numbers each of which has been 
rounded off correctly to the same place, the error in the sum may be as 
great as m/2 units in the last significant figure. 

76). Averages. An important case in the addition of numbers must 
here be considered. Suppose we are to find the mean of several approxi- 
mate numbers. Is this mean reliable to any more figures than are the 
numbers from which it was obtained? The answer is yes, but in order to 
see why let us consider the following concrete case. 

The first column below contains the mantissas of ten consecutive 
logarithms taken from a six-place table. The second column contains these 
same mantissas rounded off to five decimals. The third column gives the 


errors due to rounding, expressed 

in units of the sixth 

decimal place. 

N 

N' 

E 

0.961421 

0.96142 

1 

0.961469 

0.96147 

— 1 

0.961516 

0.96162 

— 4 

0.961563 

0.96156 

3 

0.961611 

0.96161 

1 

0.961658 

0.96166 

— 2 

0.961706 

0.96171 

— 4 

0.961763 

0.96175 

3 

0.961801 

0.96180 

1 

0.961848 

0,96185 

— 2 

Average, 0.9616346 

Av., 0.961635 

Sum, — 4 

«= 0.961635 


Av,, — 0,4 


Here we have the relation 


N^N' + B 
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for each of the numbers and therefore the further relations 


and 


SA" — + 

Sff/n — 22l^/n + 2F/n 


It will be noticed that the aretage of the rounded numbers is in error 
by only 0 4 of a unit in the sialh decimal place We may therefore call it 
correct to six decimals, or to one more place than the rounded numbers 
The entries in all numerical tables and the results of all inoasurements 
are rounded numbers in which the error is not greater than half a unit 
m the last significant figure These errors (due to rounding) are in 
general as likely to be positive as negative and hence their algebraic sum 
IS never large Usually it is less than a unit in the last figure 
The foregoing considerations justify the computer in retaining one more 
figure in the mean of a set of numbers than are given m the numbers 
themselves But rarely should he retain the mean to more than one 
additional figure 

7«) Su^iraolion Here • 

and 

(T 8) — — A«i — Ati, 

Since the errors Au^ and Au, may be either positive or negative, however, 
we must take the sum of the absolute values of the errors in order to get 
the maiimum error We then have the result that the absolute error of 
the diSereuce of two approximate numbers may equal the sum of their 
absolute errors 

When one approximate number la to be subtracted from another, they 
must both be rounded off to the same place before subtracting Thus, to 
subtract 46 365 from 779 8, assuming that each number is approximate and 
correct only to its last figure, w# have 

7798—464 — 733 4 

It would be absurd to write 779 800 — 46 365 — 733 435, because the last 
two figures in the larger number as here written are not zeros 
fd) Loss qf Sx^n^iimat Svid.'wJffve 

The most serious error connected mth the subtraction of approximate 
numbers arises from the subtraction of numbers which are nearly equal 
Suppose, for example, that the numbers 64 395 and 63 994 are each correct 



Art. 7] 


SUBTRACTION 


13 


to five figures, but no more. Their difference, 64.395 — 63.994 = 0.401, 
is correct to only three, figures. Again, if the numbers 16950 and 16870 
are each correct to only four significant figures, their difference 16950 — 
16870 = 80 is correct to only one significant figure, and even this figure 
may be in error by one unit. 

Errors arising from the disappearance of the most important figures on 
the left, as in the two examples of the preceding paragraph, are of frequent 
occurrence and sometimes render the result of a computation worthless. 
They must be carefully guarded against and eliminated wherever possible. 

The inaccuracy resulting from the loss of the -most important significant 
figures in the subtraction of two nearly equal numbers can be lessened, and 
sometimes entirely avoided, in one of two wa 5 's: 

1. By approximating each of the numbers witli sufficient accuracy 
before subtraction, when this is possible. Thus, to find the difference 
V2.03 — V2 correct to five significant figures, we take V2.03 — 1.424781 
and = 1.414214. Then 1.424781 — 1.414214 = 0.010567. Note that 
a slide-rule computation is worthless in such a case as this. 

This method is limited when the two given numbers are approximate and 
true to only a few digits. 

2. By transforming the expression whose value is desired. Thus, to find 
the value of 1 — cos z when x is small and no extended table is at hand, 
write 1 — cosa: = 2sim {x/2) in some cases, and in other cases replace 
cos X by its Taylor expansion. Then 




, X^ X* 

■) = - — — + 
’ 2 24 ^ 


In finding the area of a circular segment having a small central angle, 
replace sin 6 by its Taylor expansion. Thus 


72- 22- fl5 

Area = -^ (<> — sin 0) = y [0— (0 — -f — . .)] 

X 

2 \ 6 120 ^ J' 

otherwise the area of a plainly visible segment might turn out to be zero 
when 4- or 5-place tables are used. 

Sometimes in the evaluation of such an expression as Vu VK where 

h is only slightly less than a, one or more significant figures can be saved 
by rationalizing the expression as the first step in the calculation. Thus, 

VY— Vb = b_ _ 

Va + Vb 
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This method is of Talue ouly when fewer digits are lost by taking o — 6 
than by taking V® — Vb 

The general solution of a certain type of ladder problem in elementary 
mechani'^ ifl 

ir>i 

P ^ 

I— 

Here the terms in the numerator may be nearly equal fur oariicular rallies 
of ir, 6, and /i, and the terms of the denominator may also bt. neatly equal 
for certain values of fs I, e, and $ In such cases a slide rule computation 
may be worthless 

In making a transformation to prevent loss of significant figures by sub 
traction, each problem must be treated individually There is no known 
method or procedure that will fit all cases 

Tht loss of the Uaixng siyni/cant figxius in tht subtraction of tvo nearly 
equal numbers vs the greatest source of inaecurory in most computations, 
and it forms the weakest Unks in a ekatn computation where it occurs The 
computer must be on hte guard against it at oil times 
In general, if we desire (he diSerence of two approximate numbers to 
n significant figures, and if it e known beforehand that the first m figures 
at the left will disappear by enbtractioD, we must start with m 4* n aignifi* 
cant figures m each of the given numbers 
7e) ilultipUcaiion In this case 

Jf mm ViUjU, U, 

Since this 18 of the form (fi 9), jo which m n<» r » 1, we have 

by (6 4) 

(73) i", — Ai'T/iV — A«, /«, + Aut/u, 4- 4- Att,/it, 

The relative error of a product of n approximate numbers is therefore 
equal to the algebraic sum of the relative errors of the separate numbers 
The accuracy of a product should always be investigated by means of the 
relative error The absolute error, if desired, can be found from the relation 
- ErN 

^Vhen it IS desired to find the product of two or more approximate 
numbers of different accuracies, the more apruretp iH’jnhA'w sbssld hp 
rounded off so as to contain one more s^ificant figure than the least 
accurate factor, for by so doing we eliminate the error due to the more 
accurate factors and thus make the error of the product due solely to the 
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errors of the less accurate numbers. The final result should be given to 
as many significant figures as are contained in the least accurate factor, 
and no more. Tlie proper method of procedure in such cases will be illus- 
trated by e.vamples later on. 

7f). Division. Hero we have 

27 = Ui/uj . 

This is also of the form (6. 3), where the exponents are all unity. Hence 
by (6.4) 

(7.4) = Atti/Ui Aii2/«2 . 


The relative error of a quotient is therefore equal to the algebraic sum of 
the relative errors of divisor and dividend, but in order to get the maximum 
error one should take the arithmetical sum of the errors. 

A simple formula for the absolute error of a quotient can be found 
directly, as follows: 

Let AQ = absolute error of the quotient Ui/iZj. Then 

/ A?t, _ Au!> \ 

aO _ + A«i Hi ^ M;Ami — UiAUz _ \ u, / 

^ «2 -f- A«2 «2 «2(«2-}-A«2) Uj AWz 

Now let to denote the greatest absolute value of either Aui/u^ or Au^/us, 
and take the signs of Aitj and AUi so as to get the greatest value of A^. 
Then since Au^/Mi ^ <o, we have Auo ^ and therefore if Ui and ate 
hath subject to errors of the same order of w,agnUude we have 


AO < HilH+r) 


2ui<o 

U2(1— *-) * 


If only or u. is subject to error and the other is free from error in 
comparison with it, then 


AO < 

^ ~ U; — - toU2 «2 (1 — w) ■ 

Finally, if is negligible in comparison with 1, we get 
('^'•5) A(3^2(«2 /w,)o, 

if and are both subject to errors of the same order of magnitude ; and 

AQ ^ («i/u2)t) 

if only or u, is subject to error. 
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As in the case of products, the accuraigr of a quotient should always be 
investigated by means of the relative error, and all the statements made 
above in regard to products hold for quotients In particular, if one of 
the numbers (divisor or dividend) is more accurate than the other, the 
more accurate number should be rounded off so as to contain one more 
significant figure than the less accurate one The result should be given 
to as many significant figures as the less accurate number, and no more 
The following eramples will illustrate the proper methods of investigating 
the accuracy of products and quotients 

Example 1 find the product of 3491X8^3 4 and state how many 
figures of the result are trustworthy 

i^ijlafiort Assuming that each number Js correct to lour figures but 
no more, we have Aui ^ 0 05, AUj ^ 0 05 Hence 

+, —0000143 + 0 000057 — 0^0020 

o49 1 o63 4 

The product of the given numbers is 301413 to six figures The absolute 
error of this product is 

Ei — 301413 X 0 00020 — 60, possibly 
The true result therefore lies between 301473 and 301353, and the best 
we can do is to take the mean of these numbers to four significant 
figures or 

340 1 X S63 4 — 301400 — 3 014 X 10* 

Even then there is some uncertainty about the last figure 

Theorem II of Art 5 also tells us that the above result is uncertain on 
the fourth figure, but that the error in that figure is less than a unit 

Example S Find the tiumber of correct figures in the quotient 
56 3/V 5, assuming that the sninerator is correct to its last figure bat 
no farther 

SoJ-ultan Here we take V6 — 2 236 so as to make the divisor free 
from error in comparison with the dividend Then 

and since 56 3/2 236 = 25 2 we have 


£.<252X00009 < 0023 
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Since tliis error does not affect the third figure of the quotient, 'we take 
25.2 as the correct result. 

Note that formula (7. 6) also gives this result. 

We could have seen at a glance, without an}' investigation, that the error 
of the quotient in this e.xample would he less than 0.025 ; for the denomi- 
nator is free from error and the possible error of 0.05 in the numerator is 
to be divided by 2.236, thereby making the error of the quotient less tkan 
half that amount. 


Example S. Find how many figures of the quotient 4.89rr/6.7 are trust- 
worthy, assuming that the denominator is true to only two figures. 

Solution. The only appreciable error to be considered here is the possible 
0.05 in the denominator. The corresponding relative error is 

^ < 0.0075. 

The quotient to three figures is 


4.89 X 3.14 
6.7 


2.29. 


Hence the possible absolute error is Ea ^ 2.29 X 0.0075 < 0.02. Since the 
third figure of the quotient may be in error by nearly two units, we are 
not justified in calling the result anything but 2. 3, or 


Formula (7. 6) also gives this same result. 


Example Find the number of trustworthy figures in the quotient of 
876.3/494.2, assuming that both numbers are approximate and true only 
to the ntunber of digits given. 

Solution. Here the largest relative error is 


and the quotient is 


Hence by (7. 5) 


0.05 

494.2 


0.000101, 


876.3 

494.2 


1.7732. 


AQ = 2(1.7732) (0.000101) = 0.000358. 


Since this error affects the fourth decimal place but not the third we take 
the quotient to be 1.773. 
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Note The greatest and least Tallies of the abore quotient are 

These values agree to four significant figures and both give 1 773 
7g) Poaers and Roots Here V has the form 
JV — tt- 

Henee by (6 4) 

Rgm(A«/a) 

For the f th power of a number we put m — p and hare 
£r^p(Au/u) 

The relative error of the pth power of a number ig thus p times the 
relative error of the given number 

For the rth root of a number we put m — 1/r and get 
1 Ats 

IT 

Hence the relative error of the rth root^f an approximate number is only 
1/rth of the relative error of the given number 

Example Find the number of trustworthy figures ui (0 3862)*, as 
Burning that the number in parentheses is correct to its last figure but 
no farther 


Solution Here the relative error of the given number is 


fr — 


0 00005 
0 3862 


<0 00013 


The relative error of the result is therefore less than 4X0 00013 or 
0 00052 

The required nnmber to five figures is (0 3862)« „ 0 022246 Hence 
the absolute error of the result is 0 022246 X 0 OOO53 _ 0 000012 Since 
this error affects the fourth significant figure of the result, the best we 
can do is to write 

(0 3862)* — 0 02225 


and say that the last figure is uncertain by one unjt. 

The relative error of the fourth root of 0 3862 14 less than ^(0 00013) 
— 0 000032, and since this fonrth root is 0 78832 the absolute error of 
the result is about 0 78832 X 0 000032 — 0 000020 Hence the fonrth 
root is 0 7883 correct to four figures 
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7h). Logarithms. Here we have 

N == logio u = 0.43429 loge «• 

Hence 

= 0.43429 (A«/tt), 


or 


aN < 


1 . ^IL 

2 u 


The absolute error in the common logarithm of a number is thus less 
than half the relative error of the given number. 

An error in a logarithm may cause a disastrous error in the anti- 
logarithm or corresponding number, for from the first formula for AA 
above we have 


Aw = 


uAN 

0.43429 


= 2.3026uAF. 


The error in the antilog may thus be many times the error in the loga- 
rithm. For this reason it is of the utmost importance that the logarithm 
of a result be as free from error as possible. 


Example 1. Suppose A = logxoU = 3.49853 and Af*^ < 0.000005, so 
that the given logarithm is correct to its last figure. Then u — 3151.6 
and therefore 

Aii = 2.3 X 3151.6 X 0.000005 = 0.036. 


Since this error does not affect the fifth figure in u, the antilog is correct 
to five figures. 

Example 2. Suppose N — logio u = 2.96384 and AJV = 0.00001. Then 
w 920.11 and 

Aw = 2.3 X 920.11 X 0.00001 = 0.021. 

This error affects the fifth figure in u and makes it uncertain by two units. 

Inasmuch as the logarithm of most results is obtained by the addition 
of other logarithms, it is evident that such a logarithm is likely to be 
in error by a unit in the last figure, due to the addition of rounded 
numbers. Hence tlie corresponding number may frequently be in error 
by one or two units in its last significant figure when 'the number of 
significant figures in the antilog is the same as the number of decimals 
in the logaritlim. 

Eemarhs. The reader should bear in mind the fact that the number 
of correct figures in the antilog corresponds to the number of correct 
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dectmals jn the logarithm The integral part, or characteristic, of the 
logarithm plays no part m determining the accuracy of the antilog This 
fact IS at once erident from a consideratjon of the equation 


Au/u>-2 3Ai7 


For inasmuch as the number of correct figures in the antilog u is mea 
Bured by its relatire error, and emce thu latter quantity d fiends only on 
the absolute error and not at all on the characteristic, it is plain that 
the accuracy of the antilog depends only on the number of correct decimals 
ID the mantissa 

It 13 an easy matter to determine the number of correct figures in any 
antilog when the number of correct decimals in the mantissa is given 
Suppose, for example, that we are using n» place log tables and that the 
possible error in the logarithm of a result is one unit in the last decimal 
place, as is usually the case Then aW *— 1/10** and we hare 

83 83 1 1 

Ati/« — " 10 X lO**-* ■” 4 34 X lO--* 8 X 10*^ 

Hence by Corollary 4, Art 6, the antilog u is certainly correct to m — I 
significant figures 

The equation Au/« — 1/(4 34 X lO**"*) shows that if the mantissa is 
in error by two units m its last figure the antilog is still correct to m — 1 
significant figures, for in this case the relative error of the antilog is 


Av/u»> 


2 17 X 10—* * 


which IS less than 1/ (2 X 10" ') We are therefore justified in asserting 
that if the mantissa of a loganthm is not in error by more than two units 
m the last decimal place the antilog is certainly correct to m — 1 signifi 
cant figures 


8. The Impossibility, in General, of Obtaining a Result More Ac- 
curate than the Data Used The reader will have observed that in all 
the examples worked in the preceding pages no result has been more 
accurate than the numbers used in ditaining it This, of course is what 
we should have expected, hut sometimes computers seem to try to get 
more figures in the result than are used in the data When we apply 
Corollaries 1 and 4 of Art 5 to the errors of products, quotients, powers, 
roots, logarithms, and antiloganthma we find that in no case is the result 
true to more figures than are the numbers used in computing it The 
rcBiiJfv for these operations are as folfowa 
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(a) Products and Quotients. If fci and h are the first significant 
figures of two numbers which are each correct to n significant figures, 
and if neither number is of the form i:(1.000 • • ■) X 10'',- then their 
product or quotient is correct to 

ji — 1 significant figures if ^ 2 and Av ^ 2, 
n — 2 significant figures if either fci = 1 or it 2 == 1- 

(b) Powers and Roots. If h is the first significant figure of a number 
which is correct to n significant figures, and if this number contains more 
than one digit different from sero, tlien its pth power is correct to 

n — 1 significant figures if p ^ k, 
n — 2 significant figures if p'^lOk; 

and its rth root is correct to 

n significant figures if rh ^10, 
n — 1 significant figures if rh <C 10. 

(c) Logs and Antihgs. If h is the first significant figure of a number 
which is correct to n significant figures, and if this number contains 
more than one digit different from zero, then for the absolute error in 
its common logarithm we have 

F ^ 1 

° ^ X lO"-' • 

If a logarithm (to the base 10) is not in error by more than two units 
in the mth decimal place, the antilog is certainly correct to m — 1 signifi- 
cant figures. 

To prove the foregoing results for the accuracy of products and quotients, 
let A'l and Av represent the first significant figures of the given numbers. 
Then by Corollary 1 of Art. 5 the relative errors of the numbers are less 
than l/(2A-i X lO”-') and 1/(2A*2 X 10"'*), respectively; and since the 
relative error of the product or quotient of two numbers may equal the 
sum of their relative errors, we have 

Eelative error of result 

2A-X X lO"-* + 2A-2 X 10"-> ^ (aT ?7)2 X^10''-' ' 

Now if (1/A-. -L l/A-.) ^ 1 we have < 1/(2 X 10’'-^), and the product 
or quotient is certainly correct to n — 1 significant figures. But this 
quantity is not greater than 1 if Ax ^ 2 and h, ^ 2. Hence in this case 
the result is correct to n — 1 significant figures. If, however, either A, = 1 
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or i, — 1 , the quantity (l/fcj + l/h) > i and therefore the lelatiTe error 
of the result may be greater than 1/(2 X Hence the result may 

not be correct to n — 1 significant figures, but it is certainly correct to 
n — 2 figures 

To prove the above results for the ttxuracy of powers and roots let t 
represent the first significant figure of the given number Then the relative 
error of this nsmber is less than 2/(2t X 10* ») Hence the relative errcr 
of its pth power is less than 

P P 1 

2ir X 10* * it 2 X 10* ‘ 

The result will therefore be correct to n — 1 significant figures if {p/fc)S 1> 
or p ^ fc, and to n — 2 significant figures if p ^ lOl: 

The error of the rth root is less than 


1 1 _ I 1 10 

r 2Jj X 10* ‘ “ eb 2 X 10* • “ ri 2 X 10* 

Hence the result will be correct to n significant fignres if rlc g 10 and to 
n — 1 significant figures if ft <10 

To prove the result for the error of the common logarithm we recall 
that aV < i(Au/u), and since Ao/t < l/{2t X 10***) we have 


aK'< 


1 

4i X 10* • 


The proof for the accuracy of the antilog has already been given at the 
end of Art 7 

Since the separate processes of multiplication, division, raising to powers, 
and extraction of roots can not g ve a result more accurate than the data 
used in obtaining it, no combination of these processes could he expected 
to give a more accurate result except by accident Hence when only these 
processes are involved m a computation, the result ehonld never be given 
to more significant figures than arc contaired in the least accurate of the 
factors used Even then the last significant figure will usually be nncertain 
In a computation involving several distinct steps, retain at the end of each 
step one more significant figure than 13 required m the final result. 

While it IS true in general that a computed result is not more accurate 
than the numbers used in obtaimng it, an exception must be made in the 
cases of addition and subtraction When only these processes are involved, 
the result may be much more accurate than one of the quantities added or 
subtracted For example, the sum 3463 V3 — 3463 4-1 7 — 3464 7 is 
correct to five significant figures (assuming 3463 to be an exact number) 
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even thougli one of the numbers used in obtaining it is correct to only two 
figures. A similar result would evidently follow m the case of subtraction. 

9. Further Considerations on the Accuracy of a Computed Result. 
In commenting on formulas (7.1) and (7.3), it was stated that the 
absolute error of a sum is equal to the algebraic sum of the errors of the 
numbers added, and that the relative error of a product is equal to the 
algebraic sum of the relative errors of the factors. The word “ algebraic ” 
deserves emphasis in these cases because errors of measuremnt and errors 
due to rounding are compensating to a very great extent, so that in most 
cases the error in a computed result is not equal to the arithmetical sum 
of the errors of the numbers from which the result was obtained. 

We saw in (7b) that the error in a sum was only a small fraction of 
the arithmetic sum of the separate errors. That the errors of the factors 
in a product are also compensating may be seen by considering’the product 
of two exact numbers : 


649.3 X 675.8 == 438,796.94. 


Now suppose we round off these numbers to 649 and 676. Their product 
is then 649 X 676 = 438,724. The actual error of this product is 72.94, 
and the relative error is 


72.94 

438,796.94 


0.000166. 


The relative errors of the factors are 0.3/649.3 = 0.000462 and — 0.2/675.8 
= — 0.000296. The relative error of the product is thus less than the 
relative error of either factor and is actually equal to their algebraic sum. 
The product in this case is more accurate than either factor. 

When a long computation is carried out in several steps and the inter- 
mediate results are properly rounded at the end of each step, there is no 
accumulation of rounding errors. If there were, long astronomical com- 
putations, such as those of eclipses and the orbits of comets, would be 
worthless. Time and experience have proved the correctness of such 
astronomical computations. In a chain computation tlie loss of significant 
figures by subtraction is the chief source of error. 

Bad advice is sometimes given in regard to computation. In the addi- 
tion of numbers of unequal accuracy, .some writers advise that all the 
numbers first be rounded off to the number of decimal places given in 
the least accurate number. Wlien this is done, the computer throws away 
definite information and replaces it with uncertainty. In adding a column 
of several numbers, the uncertainties might largely cancel one another, 
but this would not be the case with only a few numbers. The proper 
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method is to add the more accurate numbers separately and then round 
off their sum to the same decimal place as the least accurate number or 
numbers In this way the sum is as accurate as the least accurate of the 
numbers added 

Similar bad advice is given m the case of multiplication and division 
When multiplj mg or dividing numbers of unequal accuracy, some writers 
advise that all numbers first be rounded otf to the same number of eignifi 
cant figures as contained in the least accurate factor To make all factoi;s 
as rough as the roughest one is lolly There is no sense in throwing 
away perfectly definite information and replacing it with a question mark 
The more accurate iaciors should be kept with ons more significant figure 
than the least accurate factor Then the result will usually be as accurate 
as the least accurate factor The correct procedure in all ordinary com 
putations can be stated m 

A Sound and Safe Rule ^Vhe^ computing with rounded or approximate 
numbers of unequal accuracy retain from the beginning one more signifi 
cant figure in the more accurate numbers than are contained m the least 
accurate number Then round oS the result to the same somber of 
significant flgu’es as the least accurate number 

In the case additioo retain in the more accurate numbers one more 
deeimaJ digit i n is cootamed is the least acenrate number 

This rule follows from equations (7 ] ), (7 3) and (7 4) By retaining 
one more digit in the more accurate numbers we reduce to sero the errors 
of those terms and thus reduce the error of the final result 

In the case of subtraction or of addition of only two numbers round oS 
the more accurate number to the same number of decimal places as the 
less accurate one before subtracting or adding 

10 Accuracy in the Evaluatton of a Formula or Complex Expression 
The two fundamental problems nnder this head are the following 

(a) Given the errors of several independent quantities or approximate 
numbers to find the error of any function of these quantities 

(b) To find the allowable errora m several independent quantities in 
order to obtain a prescribed degree of accuracy in any function of these 
quantities 

lOa) The Direct ProbJem The first of these problems is solved by 
tepkcing the given approximate numbers by the letters a,b,c, or 
u, ut «, taking the partial derivatives of the function with respect to 
each of these letters and then substituting in formula (6 1) or (6 2) 
An exact number, such as 2 3, 10, etc, is not replaced by a letter before 
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taking the derivatives * We shall now work some examples to show the 
method of procedure. 

Example 1. Find the error in the evaluation of the fraction 
cos t° lO'/logio 243.7, assuming that the angle may be in error by 1' and 
that the number 242.7 may be in error by a unit in its last figure. 


Solution. Since this is a quotient of two functions, it is better to 
compute the relative error from the formula Er ^ Au^/ui -f- and 

then find the absolute error from the relation Ea — NEr- Hence if we 


write 


we have 


cos 7° 10' 
^ ” logic 242.7 


cos X 

logic y 


— Ui/Uz 


AUi = A cos a; == — sin a:Ax, 


or 


A «2 = A logic y = 0.43429 ( Ay/y) . 


, _ - sina: . , 0.43429 

• • : Aa;-f -. - t::::-- Ay, 


cos X 


Er ^ tan a:Aa: -1- 


ylogy 
0.435 


yiog«/ 


Ay. 


Now taking a; = 7° 10', Aa; = 1' == 0.000291 radian, y = 242, Ay = 0.1, 
and using a slide rule for the computation, we have 


0 4^^ V 0 1 

Er < 0.126 X 0.000291 + = 0.00011. 

Since N = cos 7° lO'/log 242.7 = 0.41599, we have 

Ea = 0.00011 X 0.416 = 0.000046, 


or Ea < 0.00005. 

The value of the fraction is therefore between 0.41604 and 0.41594, 
and we take the mean of these numbers to four figures as the best value 
of the fraction, or 

N = 0.4160. 


Example 2. The hypotenuse and a 'lide of a right triangle are found 
by measurement to be 75 and 32, respectively. If the possible error in 

• Adopted or accepted values of physical, chemical, and astronomical constants are 
to be treated ns exact numbers, but results obtained by using these numbers as 
multipliers or divisors are not to be relied upon to more significant figures tnan are 
used in the constants themselves. 
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the hypotenuse is 0 2 and that m the fide is 0 1, find the possible error 
in the computed angle A 

Solufton Lettering the triangle in the usual manner, we hare 
Bin A — 32/75 — a/e 


and 


Now 


AA — (ai4/aa)A<i+ (34/ac)Ac 

iA/Za^^X/y/e' — a*. 


ZA/de — — a/(cVc* — a* ) 

Taking the numerical raluea of e and a in such a manner as to gire the 
upper limits for ZA/da and ZA/ic, and remembenug that Aa ^ 0 1, 
Ac — 0 2, we hare 


Ail< 


32 1 


V(T4 8)* — (32 1)» “^74 8 V(74 8)‘ — (32 1)* 

AA < 0 0028 radian — 9^38" 


X02 — 000275 


The possible error in A is therefore leas than 9' 38" 
lOi) The Inverat Proitem We now turn our attention to the Becond 
fundamental problem mentioned at the beginning of this article that 
of finding the allowable errors in u. when the function If u 

desired to a given degree of accuracy This problem is mathematically 
indeterminate, since it would be possible to choose the errors AUi, Au„ etc 
in a rarietj of ways so as to make AiF fess than any prescribed quantity 
The problem is solved with the least labor by usmg what is known as 
the pnnnple of eqval effects • This principle assumes that all the partial 
differentials (3N/3 ui)a«„ (dif/3u,)Avi, etc, contribute an equal amount 
in making up the total error AW Under these conditions all the terms 
ID the right hand member of equation (6 1) are equal to one another, 
so that 


Hence 



AUx 

n 




Au,— 

n 


aw 

Su, 


• See Pslmer'e TA«o”ir cf Ueatvrement*, pp 147 148 
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Example S. Two sides and the included angle of a trianglar city lot 
are approximately 96 ft., 87 ft., and 36°, respectively. Find the aUowahle 
errors in these quantities in order that the area of the lot may he deter- 
mined to the nearest square foot. 

Solution. Writing 5 = 96, c = 87, 4 = 36°, and denoting the area 
by u, we have 

u = lie sin Z == f (96 X 87 ein 36°) = 2455 sq. ft. 

Hence 

du/db = Ic sin A, du/dc = lb sin A, du/dA <= Ibc cos A. 
Substituting these quantities in (6.2), we find 

Ati/u Ab/b ^c/c AA/tan A. 


Now since the area is to be determined to the nearest square foot we 
must have Aw < 0.5 ; and by the principle of equal effects we must have 


A6 1 0.5 

b ^3 w 3 X 2455 ' 

Hence A6 < 96 X 0.000068 = 0.0065 ft. 
In like manner , 


1 

14730 


< 0.000068. 


Ac 1 Aw 
c 3 w 


, or Ac < 87 X 0.000068 = 0.0059 ft. ; 


and 


1 Aw A.A 

= , or A4 < tan 36° X 0.000068 = 0.000049 radian. 

3 w tan A 


Hence from a table for converting radians to degrees we find AA = 10". 

It thus appears that in order to attain the desired accuracy in the area 
the sides must be measured to the nearest hundredth of a foot and the 
included angle to the nearest 20" of arc. 

This problem could also be solved by assuming that the possible errors 
in the measured sides might be 0.005 ft. and then computing the per- 
missible error in the measured angle. 

Example 4- The value of the function 6i^ (logic x — sin 2y) is required 
correct to two decimal places. If the approximate values of x and y are 
15.2 and 57°, respectively, find the permissible errors in these quantities. 

Solution. Putting 

« -= 6r®(logio5: — sin 2y) 6 (15.2)* (log, o 15.2 — sin 114°) 

371.9, 
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we have 

gti/3i — 12i (logic* — einZjf) +€* X 0 43429 — 88 64, 

0 u/gy _ _ 122 :* coa 2 y — 1127 / 

Hence 

Ati — (0u/3a:)Ax + (Ou/0y)Ay“* 88 64Az -}• 1127 7Ay 

In order that the required result be correct to two decimal places we 
must hare Au < 0 005 Then by the pnnciple of equal effecb we hare 


0u ^ 2 X 88 54 


2 ^ 

ay 


; — 0 0000022 rad 


Since the permissible error in z is only 0 00003, it wiU be necessary to 
take X to seren significant figures in order to attain tbs required degree 
of aeeurscy in the result. The ralue of y can then be taken to the nearest 
second 

The reason why the permissible errors m x and y are lo small m this 
example is that the factor logt«X'— sin2y causes the loss of one significant 
figure by subtraction 


Btmarle It is neither necessary nor desirable to lUTeatigato the accuracy 
of all proposed computations But when we are in donbt about the possi 
bility of attaining a certain degree of accnracy in the final resnlt, we 
should make the necessary inrestigation It usually suffices to carry all 
computations to one more figure than is desired in the final result and 
then round off the result to the desired number of figures, if the aceoracy 
of the given independent quantibes u such as to permit this 


11 Accuracy in the Detennlnation of Arguments from a Tabulated 
Function. In many problema it la necessary to compute some function 
of an unknown quantity and then determine the quantity from tabnlated 
values of the function Examples of this kind are the determination of 
numbers from a table of logaritbnu^ and angles from trigonometric tables 
If the computed function happens to be affected with an error, the argu 
ment determined from this function is necessarily incorrect in some degreo 
The purpose of this article is to investigate the accuracy of the argument 
whose value is required 
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In tables of single entry are tabulated functions of a single argument. 
Calling X the argument and y the tabulated function, we have 

From this we get the relation 

Ay = f(x) Ax, approximately, 

from which we have 

(11.1) Ax^Ay/f{x). 

This is the fundamental equation for computing the error in arguments 
taken from a table. Here Ay represents the error in the computed function 
whose values are tabulated, and Ax is the corresponding error in the argu- 
ment. It will be noted that the magnitude of Aa: depends upon three 
things: the error in the function, the nature of the function, and the 
magnitude of the argument itself. We shall now apply (11. 1) to several 
functions whose values are tabulated. 

1, Logarithms, 

(«) /(s) =logea:. 

f{x)=l/x. 

(1) Aa: = a;Ay, from (11.1). 

(6) /(a:) “logic®. 

f (x) = M/x, where M — 0.43429. 

.’. Aa: = xAy/M = 2.3026a:Ay. 

Hence 

(2) Ai < 2.31a:Ay. / 

S. Trigonometric Functions. 

(o) /(®) = sin X. 

f (x) «= cos X. 

(2) . . Aa: = Ay/cos x «= sec a:Ay radians, 

or 

(&) 


( 4 ) 


(Aa:)'' =■ 206264.8 sec xAy seconds. 
f{x) =tana:. 
f{x) ^ sec* a:. 
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(6) 


(Ai)" -- 206264 8 cos*xAy seconds 


(«) 

/(*)-log„Bmx 

(7) 


Ax ~ . f* — — 2 3026 tan lAy radi-ns 

3f cot z 

(8) 


(Ax)' <475000 tan zAy seconds 


w 

/(z) — log, 6 tan z 



■ 

j (X) — ii ^ * cos z Bin 2z 



^ ^ j 1513 gin 2rAy, 

<9) 


Az < 1 16 Bin 2zAy radians, 

and 



(10) 


(Az)” < 238000 sin 2zAy seconds 


S Etponentidl FwicUons 

f{x) — «• 

r{x)~e' 

(11) A* — Ay/e» 

4 OtKer T&bulaftd F«ncttoiw By m«BQ8 oi tbe fund&menial eqaation 
(11 1) we can compute the error in any argument when the denrative of 
the given function la given or can be easily found. In Jahnke and 
Emde’s Funkttoneniafeln, for instance, are tabulated the derivatives of 
logr(a: + l), the error function f^e^dx, the Wcierstrass p function, 
p(ii), end Legendre’s polynomials Hence by means of these tables 

we can determine the arugment and also its error 
Elliptic integrals are functions of two arguments The error in each 
of these arguments can not be determined uniquely, but by using formula 
(6 1) and assuming the principle of equal effects we can find definite 
formulas for the errors in the arguments Thus, denoting an elliptic 
integral by / and the function of the arguments by F{$,^), we have 
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Hence 

Ai = {dF/de)Ae + (9i?’/9<#.) 

By assuming that the two terms on the right-hand side are equal, we get 

a7 A7 

A0— . A.^, — . 

^d4> 

Knowing the error A7 of the integral, we can find from these formulas the 
corresponding errors in € and 

Remarks. Comparison of formulas (3) and (5) shows that the error 
made in finding an angle from its tangent is always less than when finding 
it from its sine, because cos" x is less than sec x. The latter may. have any 
value from 1 to oo, whereas the value of the former never exceeds 1. 

formulas (7) and (9) show still more clearly the advantage of deter- 
mining an angle from its tangent. It is evident from (9) that the error 
in X can rarely exceed the error in y, since sin 2x can not exceed 1, but 
(7) shows that when the angle is determined from its log sine the error 
in X may be many times that in y. 

Let us consider a numerical case. Suppose w'e are to find x from a 
5-place table of log sines. Since all the tabular values are rounded numbers, 
the value of Ay may be as large as 0.000005, due to the inherent errors of 
the table itself. Taking a: = 60° and substituting in (7), we get 

Ax = 2.3026 X 0.000005 
= 0.00002 radian, about, 

= 4 " 1 . 

The unavoidable error may therefore be as great as 4 seconds if we find 
X from its log sine. 

If, on the o^her hand, we find x from a table of log tangents we have 
from (9) 

Ax < 1.16 X iV^X 0.000005 ^ 0.000005 rad. 

-=T'. 

The error is thus only one-fourth as great as in the preceding case. 

The foregoing formulas simply substantiate what has long been known 
by computers: that an angle can be determined more accurately from its 
tangent or cotangent than from its sine or cosine. 

Note. The problem of determining the maximum possible error in a 
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result found by means of tables » rsther involved The reader will find 
a masterly treatment of this matter in J Luroth’a TarUsungtn uler 
numerisches Reeken Leipzig, 1900 

Hoffever, the problem la of little practical importance, because the errors 
m anch a computation rarely if ever combine so as to produce their 
maximum aggregate effect They neutralize one another as the calcu 
lation proceeds 

12 The Accuracy of Series Approximations. It is frequently easier 
to find the numerical value of a function by expanding it into a power senes 
and evaluating the first few terms than by any other method. In fact, this 
13 sometimes the only possible method of computing it The general 
method for expanding functions into power senes is by means of Taylor’s 
formula The t«o standard forms of this formula are the following 

(1) + /"(a) + 

+ + 0<«<1 

(8) «,+i)-/(«)+).r(.) + ^r(*>+ I /"”(«) 

+ + 0<»<J 

On putting a 0 m (1) we get Haclaunn’s formula 

(3) /(,)_,(0)+,/'(o) + ^r(o)+ 

+ 0<»<1 

The last term in each of these three formulas is the remainder after 
n lerme This remainder term u the quantity in which we shall be 
interested in this article The forms of the remainder given above are 
not the only ones, however Another useful form will be given below 
ISa) The Remavnder Terms tn Taylor's and Maelaui^ns Senes De 
noting by fl,{a;) the remainder after n terms in the Taylor and Uaclaurin 
expansions, we have the following useful forma 
1 'For Taylor’s formula ( 1 ) 

(«) o<s<i 


Abt. 12] 


SERIES APPROXIMATIONS 


33 


2. For Taylor’s formula (2) : 

(a) = + 0<6<1. 

(b) Rn{x) = (x + ft — t)i-HL 

3. For Maclaurin’s formula: 


(c) Bn(x)==^f(^H6x), 0 <e<l. 

TV ! 

{h) Rn{x) = 

It will be observed that the second form (the integral form) is perfectly 
definite and contains no uncertain factor 6. In using either form, however, 
it is necessary first to find the nth derivative of f{x). 

Since the integral form of Rn{x) is not usually given in the textbooks 
on calculus, we shall show how to apply it to an example. 

Example. Find the remainder after n terms in the expansion of 

ioge (^4-ft)- 
Solution. Here 

f{x) =l 0 gfX, 
f(x)=l/x, 
r(x)=-(l/x=), 
r(x)=2/xS 
/iv(2;) (6/x«), 


/(")(x) 


(— 1)! 
X" 


Rn{x) = (— 1)”-' 


(n — 1)! f* 

(n — l)Uo 


1 

(x -f ft — <)” 




How since t varies from 0 to ft, the greatest value of Rn{x) is obtained 
by putting t == ft in the integrand. We then have, omitting the factor 
( — 1)"'% which is never greater than 1, 
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Suppose z — 1, A — 0 01 Then A/z — 0 01 If, therefore, •we wish to 
know how many terms m the expansion of log, 1 01 are necessary in order to 
get a result correct to Beren decimal places we take R, ^ 0 00000005 


(1/n) (0 01)* — 0 00000005 

It IS evident by inspection that n 4 will give a remainder much smaller 
than the allowable error Hence we lake four terms of the expansion of 
log, (z + A) 

The reader can easily verify that th» first form of remainder gives th» 
same result as that ]ust found 


ISh) AUertiaUng Stnts An alternating series is an infinite series in 
which the terms are alternately positive and negative Such a senes is 
convergent if (a) each term is numerically less than the preceding and 
(b) the limit of the nth term is zero when n becomes infinite 
Alternating series are of frequent occurrence in applied mathematics 
and are the most satisfactory for purposes of computation, because it is 
always an easy matter to determine the error of a computed result The 
rule for determining the error is eimply this 

In a conrerpent aHematinp senes the error eommillrd tn sfoppinj wslA 
any ttrm ts olicuys Itsi (Aon fA< first term ntgleclei 
Thus, since 


log, ( 1 4- z) — z — z*/2 + z*/3 — x*/4. + z*/5 — 

we have 


where B < | (0 01) V4 | — 0 0000000025 
Ve therefore get a result tme to eight decimal places by talcing only 
three terms of the expansion 

ISc) Some JffiportanI Senes and Tknr Remainder Terms Below are 
given some of the most useful senes and Uieir remainder terms altematmg 
series not bemg included because their remainder terms can be computed 
by the mle given above 
1 The Binomtal Senes 


(l + z)“— 14 - mz + - 


, w(m — l)(m 


v>(m — l>(m— 2 ) 


(n~l)l 


31 

(m— n4-2) . 


*4- A.. 
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where 

(.) + 0<9<1. 

in all cases. 

(S) R,< +-1) ^. ii*>0. 

n! 


- a;»* if a: > 0. 


(c) B^c — 1)(^ — 2) • • • — ^ + 1) ic" 

' ' ^ n! (1 + a:)"'” 

if s < 0 and n'> m. 

id) .B„ < I a:" 1 (1 +a;)" if — 1 < m<0. 

If m is a fraction, positive or negative, or a negative integer, the binomial 
expansion is valid only when ] a: j <1. Also, except when m is a positiDe 
tnteger, a binomial such as (a + &)*” must be written in the form 

+ if a > b, or S’” (l -f if b > a, 

before expanding it. 

2. Exponential Series. 

(a) = l -f ar + Hl 4- 51 j i 4- ~e^^> 

-r -1-21^3!^ („_ 1 ) I + „( • 

(i) »._i + *i„g.+ (£>^ + ... + l£l 28 ^.+'(£]£^„,, 

(n — 1) 1 n\ 

If in (a) we put a; »= 1 we get the following series for computing e : 

(c) e = 1 4- 1 4- - 4- — 4--l_4. • . . 4. 


But since e < 3 and 6 ^ 1, it is plain that 

R.<~. 

n\ 

A more definite formula for Ii„ can be found as follows : 
Writing more than n terms of the series (c), we have 

c— r l-f 1 4- JL4--I4.. . . I I ~} 

L ^ ^2!^3!+ + (n — l)!j 

4- — I i I I . 

^ nl ‘ + (n + 2)!'^' ■ 
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wbeie tlie remainder after n terzna u 


(n + l)!'*' {n + 2)l + 

The tjuantUy m paiinUicsia on tie tight » clearly less then the sum of 
the geometric aeries 

1 + 1/ft +!/«* + !/«* + 


the sum of which is 


Hence 

(0 


1 _ n 

1 — 1/ft ft — 1 ‘ 


K<i 


ft 

ft— 1 ' 


P»< 


1 


By means of this formula (e) we can find the requisite number of 
terms in the expansion (c) to gite the talue of e correct to any desired 
number of decimal places Thus, if we wished to £nd e coned to ten 
decimal places by means of the aeries (c) we would find n from the eqna 
tion l/(ft — l}(n— 1)1 — 000000000005 With the aid of a table of 
the recipTocala of the factorials we find that n — 1 — 13, or n — 14 We 
should Uerefore take 14 terms of the aeries (c) We find is Lke manner 
that in order to compute e correct to 100 decimal places we should take 
71 terms of the series (e) 


5 Loganihmte Senu 


+ 


(2ft— l)(2ift + l)> 


-] +fi.. 


To find an upper limit for rre hare 


L(2ft + l)(2m + l)« 




{2n + 3) (2m + l)»» 


■•■(2» + 5)(2m + l)«-* + J 

Each term of the aeries in brackets, after the first, is leas than the corre 
sponding term of the aeries 





i’ii.CVl 


A' 




?7 


V'-* 




1 , . . . 


* (£n-f l)t?r" -f 1)-'^^' * 

r Pl~ ^ 4- 

(£r, 4- 1) (£n -h L ' (?n -f 1)* ^ -f 1)'* ^ J 

"!:::4 i? s sreoraetric series vith ratio 77; — ■ Vs 'V 
* (2**>4-i) 


(2n-f 1)’- 


Rn<: 

Therefore 

{&) 


{(2r, 


Of .(ti!L~hi-Il Hence 

4m(m + l) ^ 


1 


\ 

+ 1) (2m 4- 1 ) / 4m (m 4 1 ) 

1 1 


En< 


2 m(m4 l)(2«4l)(2m41)‘''*'' 

1 1 

2 m(m 4 1) (2n 4 1) (i'm -j- 1)*"-' ’ 


Ezamph 1. To compute In 2 *' by taking tliree tovmn of (n) wo have, 
since m =« 1, n •=• 3, 


and by (b), 




En <C „ 


0.000147, 


2 2(7) (3)' 

which affects the fourth decimal place. Since the true value of In 8 to 
eight decimal places is 0.G9314718, the error in the value found above la 
0.000143, which is less than 0.000147. 


Example S. To find In 5 correct to ion decimal placen wo have m 4, 
Jl„ *= (1/2) • (1/10‘°). Uonce, by (l>), 

1 1 1 

2 4Xfi(2fi41)(fi)'''"” *“2 10'“' 

or 

(2n 4 1) (9)*"'‘ 5 X 10" — f.00,000,000. 

We find by trial that n is about 4. 1, and that for n fi ihe lognrjlhrn will 
be correct to 11 decimal places. 


Freqnpntly in liiin book wp filmil 'writ*' In for lo/jr,. 
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ISd) Some nfh Denvaiivea In competing the remainder term in a 
series it is necessary to hare the nth denratire of the giren function. 
To facilitate the calculation of 5, we therefore give below a list of nth 
deriratives of some simple functicms The symbol f? denotes differentia 
tion with respect to i, ox D — d/dx 


{«) 

Dm* — a*(log« a)* 


(6) 

D* 8in» — Bin[x + «(ir/2)] 


(0 

D* cos* — •cos[x+ n(w/2)] 


(d) 

„ / I \ (_l)-n'S- 

Va + b*/ (fl+br)"' 


(0 

B./ > \ (-l)-13 5 .(gjL- 

■Jii- 




wJ 

D log.(a + bt)- (a+bi). 


(?) 

H^)~ (* + i + 1 + 

+ W] 

(A) 

D*log« (J 4- *‘1 •“ (— !)• ’2(n — l)*cos |^n8m * | 

' ' n 

kV) +»■/-! 


(1 + **)•/» 


(*) 

C- to . X - ( [„ „„ . ( 

(J) 

+ [<" + »"" ‘ (vTT?)j 

(fc) 




-f (« + Pa)8in(fi + 1)?] 


where 




#>— V(*— + 
tsm* — 5 — 

X — a 

For an extensive investigation of nth derivatives the reader is referred 
to Steffensen’a Interpolation, pp 231 241 
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13. Errors in Determinants. When the elements in a determinant are 
inexact numbers, due to rounding or otherwise, the value of the deter- 
minant may be seriously affected by the loss of the most important sig- 
nificant figures in the expansion or evaluation process. The amount of 
such losses cannot be determined in advance. We can, however, determine 
the upper limit of the error in a determinant whose elements are subject 
to given possible errors. For purposes of illustration we consider a deter- 
minant of the third order. 


Let 

( 1 ) 





Z-3 

Z7 = 

yi 

y=^ 

ya 



Zi 

23 


Now if the elements are subject to possible errors of unknown signs but of 
magnitudes Arj, Ayi, etc., which are small in comparison with Xi, yi, etc., 
then the value of D will be subject to the possible error A2? such that 


( 2 ) 


D-fAZ? 


ij -r All Sl 2 

Vi 4- Ayi yi + £^y-j 

Zi Azi Zj Az- 


iCg —j— AXg 
ya + Ayg . 
Z3 -j- AZg 


By the addition theorem of determinants the right member of (2) can 
be expressed as the sum of eight determinants, the first of which is the 
original determinant D. Each of three of the remaining determinants 
contains one column of error elements, each of three of the others contains 
two columns of error elements, and the remaining determinant has three 
columns of error elements. All determinants containing more than one 
column of error elements will be neglected, because, when expanded, the 
resulting terms will all contain second and third powers of the errors and 
will therefore be negligible in comparison with terms containing only the 
first powers of the errors. The value of A D is thus the sum of three deter- 
minants each containing a single column of error elements. 

But those determinants are only the differeniial of D, and we therefore 
have 


dXi Xj Xj 


Xt dXi Xg 


arg dxg 

(iyi yi yi 

+ 

yi dy, yj 

+ 

yi y* dyg 

dzi ij jj 


dZ^ 2g 


2l 2- c/Zj 


(3) (iZ? = 
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or 

(4) dD— (y x,—y,t,)djri-~(T^i~-Sji,)dyi+(i,]f,—x,y,)dzi 


— (yiXi^y>xi)dz, ■+ (j-iij— ».xi)rfy> — (i.y*— 


The isasimum possible error erould occur whea the stgas ot the elemeaU 
and the signs of the errors were such that all the eighteen terms m the 
right member of (4) were of the same sign— a very remote possibility 

Equation (4) shows that the error in a determinant composed of inexact 
elements may be anything from xero up to a number of considerable mag- 
nitude It must be borne in mind, however, that the terms in (4) will 
largely cancel one another so that in general, dD will not be large 

14. A Fual Bemark. The preaeot chapter may appropriately close 
with the followtag lines from Alexander Pope 

A little learning » a dangerous tbmg. 

Dnnk deep, or taste not the Pierian spring 
There shallow draughts intoxieste the brain. 

And dnnking largely sobers us agum 

Pope was probably not thmlong ol appioximaie calculation when he 
wrote those lines, but no better advice could be given with respect to that 
subject A smatter of knowledge of approximate calculation la worse than 
no knowledge at all Fragmentary knowledge may lead to rough results 
that cannot be trusted The author has seen students and teachers obtain 
far worse lesulta from applying ba^ ideas of the subject than if they had 
never heard of it Their faulty work was due mostly to drastic rounding 
of numbers (at the beginning o! a computation or at intermediate steps) 
or to dropping non negligible terms in a aenea 

The essence of this chapter cannot be given in one or two recitations, 
nor m two or three If the teacher has only two or three recitatioua to 
devote to it, he had better leave it out entirely 


EXERCISES I 


1 Bound off the following numbers correctly to four significant figures 
63 8543, 93487, 0 0063945, 83615, 363042, 0 090038, 53908 
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2. A carpenter measures a 1 0-foot beam to the nearest eighth of an 
inch, and a machinist measures a |-inch bolt to the nearest thousandth 
of an inch.* Which measurement is the more accurate? 

3. The following numbers arc all approximate and are correct as far 
as their last digits only. Find their sum. 

136.421, 28.3, 321, 68.243, 17.482. 

4. Find the sum of the following approximate numbers, each being 
correct only to the number of significant figures given: 

0.15625, 86.43, 191.6, 432.0 X 10, 930.42. 


5. The numbers 48.392 and 6852.4 are both approximate and true only 
to their last digits. Find their difference and state how many figures in 
the result are trustworthy. 


6. Find the value of VlO — w correct to five significant figures. 


7. The theoretical horsepower available in a stream is given by the 
formula 


H.P. 


whQ 
560 » 


where h = head in feet, Q = discharge in cubic feet per second, and w =» 
weight of a cubic foot of water. The weight of fresh water varies from 
62.3 to 62.5 lbs. per cubic foot, depending upon its temperature and purity. 

If the measured values of Q and Ji are Q = 463 cu. ft./Bec. and 
h =. 16.42 ft., find the H. P. of the stream and indicate how many figures 
of the result are reliable. 


8. The velocity of water flowing in long pipes is given by the formula 


V 


2ghd 

fl 


ft./sec.. 


where g = acceleration of gravity ■= 32.2 ft./sec.* 

h «= head in feet, 
d «== diameter of pipe in feet. 

I = length of pipe in feet, 
f = coefficient of pipe friction. 

• IVTicn a measurement is recorded to the nearest unit, the absolute error of the 
measurement is not more than half a unit. 
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In this problem the factor / is the most uncertain It Tariea from 0 01 
to 0 05 and is usually somewhere between 0 02 and 0 03 Assuming that 
f is within the limits 0 02 and 003 and taking 
g — S2Z, 
h — 112 feet, 

cf » J foot (assumed exact) 

I — 1865 fMt, 

ilnd V and indicate its rcliahilitj 

9 The Telocity of water m a short pipe is given by the formula 




where h, fi I and d have the same meanings aa m the preceding 
example Taking } — ?S feel and the other data the same as in Ez 8, 
find V and indicate its reliability 


10 The acccUration of gravity at any point on the earth’s surface is 
fiTcn by the formula 


j — 32 mi — 0 08211 eoa 2L — 0 00000311, 


where S •m altitude in feet above sea level and L ■■ latitude of the place 
It thus appears that the value of g is not 32, nor 32 2, nor even 32 17 
Compute the kinetic energy of a 100 pound projectile moving with a 
velocity of 2000 feet per second by taking 4; equal to 32, 32 2, and 32 17 
in succession and note the extent to which the results divagree after the 
first two or three figures 


11 How accurately should the length and time of vibration of a pen 
dulum be measured in order that the computed value of p be correct to 
0 05 per cent’ 

12 If in the formula 



the percentage error ir R is rot to exceed 0 3 per cent, find the allowable 
percentage errors in r and b when r — 48 mm and b = 56mm 

13 When the index of refraction of a liquid is determined by means 
of a refractometer, the index n n given by the formula 

n— VAT* — am' $ 

If “ 1 62200 with an unceitamty of O C0004 and 6 — 38” approximately, 
find Afl in order that n may be reliable to 0 02 per cent. 
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14 . Tlie area of the cross section of a rod is desired to 0.2 per cent. 
Ho-w accurately should the diameter be measured? 

15. The approximate latitude of a place can be easily found by 
measuring the altitude h of Polaris at a known time t and using the 
formula 

L = h — p cos <, 

where p = polar distance = 90° — declination. 

Treating p as a constant and equal to 1°07'30^^, and taking h = 41°^25', 
t = 0'’38"‘42-\ find the error in L due to errors of V in h and 5® in t. 

16 . In the preceding example find the allowable errors in h and t in 
order that the error in L shall not exceed 1', using the same values of p, 
t, and h as before. 

17. The distance between any two points Pi and on the earth’s 
surface is given by the formula 

cos P = sin Pi sin Lz -f- cos Li cos Lz cos (Ai — Aj) , 

where P,, P- and Ai, Aj denote the respective latitudes and longitudes of 
the two places. Find the allowable errors in P,, Lz, Ai, Aj in order that 
the error in B shall not exceed 1' (a geographical mile), taking 

P, = 36°10'iV, Pj = 58°43'i^, A, = 82°15'1F, Ai = 125°42' IF. 

18. The fundamental equations of practical astronomy are; 

(1) sin h = sin S sin P cos S cos P cos i, 

(2) cos h cos = — sin S cos P cos S sin P cos f, 

(3) cos h sin == cos 3 sin t, 

where 3 denotes declination, t hour angle, li altitude, and A azimuth of 
a celestial body and P denotes the latitude of a place on the earth. The 
declination 3 is always accurately known and may therefore be considered 
free from error. 

Differentiating (1) by considering 3 constant and h, L, t as variables, 
we have 

cos h dh = sin 3 cos LdL — cos 3 sin P cos tdL — cos 3 cos P sin t df. 

Eeplacing cos 3 sin P cos t and cos 3 sin t on the right by their values from 
(2) and (3), respectively, we get 

dk == — (cos AdL sin j 4 cos P d<) . 
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Solring for dL, 

(4) — (s«e^(U + UQ/lC08Ld0 

This eqastioa ihovi thit ths numerical Talus of dL is leut when A is 
near 0® or 180®, that is, when the bod/ u near the meniwn If A should 
he near 90®, that is, if the body ehould be near the prime rertical, the 
error in L might be enormous Hence when determining latitude the 
ohserred body should be aa near the meridian as possible 
Using equation (4), compute dL when dA — 1', <f< — 10', Zr»-40®, 
/ — 10®, and A — 80® 

19 Using the formula d£i —-^(aeeAdA + tan A cosXdf), iud the 
allowable errors in t and h in order that the error in L may not exceed 1' 
when L ~ 40® and (a) A — lO® and (b) A — 75® 

20 From the relation 

coa hih — (am S coa £r — coa t am Lcoa t )<t£> — cos 5 cos I> am tit 
we find by means of (2) and (3) of Ex 16 

41 d\+eoi Adh 
" ein A cos L 

This equation shows that dl is least numerically when A is near 90®, that 
IS, when the observed body is near the prime vertical, it also shows that 
when the body is on or near the prime vertical an error in the assumed 
latitude haa practically no effect on the error in ( 

Compute dt when d\ — 1', dL — 5', £ «> 40®, A 10®, and A » 60® 

21 Using the formula for dl id the preceding example, find the allow* 
able errors in L and A in order that dl may not exceed 3‘, taking L 40®, 
A — 10® and A»80* 

22 Using tl 0 formula o! Ex 20, take dl 3*, dA — 1', and find dL 
for A » 10® and A — 80” 

23 III tlie equation 

X .^asin (At + a) 

suppose o- k and « are subject to the errors Aa, At, A«, respectively 
Compute Az and see which of the errors As AA, Aa is the most potent 
in caus ng an error in x 

24 Fmd the value of 

/«»»^ (*iix/x)itr 


correct to five decimal places 
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25. Compute the value of the integral 

rvii 

/=. I VJ —0.162 sin'drf.#. 

'' 0 

correct to five significant figures by first expanding the integrand hy the 
binomial theorem and then integrating the result term by term. 

26. In the formula 

. sin^(Ai — fe»)co3|(fe, + A8) 

8in^(fi — ts)coshi 

k denotes an angle; h„ h^, hs, tj are all positive; (/i, — ha) and (f, — ts) 
are small quantities; and (hi — hi) is small in comparison with h^. Find 
the maximum error in k due to errors in t and h, assuming that 

1 dhi I = I dhi I «= I dhi ) and | dt, j = | dta |. 

27. Using the result found in Ex. 26, find the maximum value 
of dfc when dt = O'.OS, d/t = 0'.05, A, = 40°, A, = 40° 15', A, = 40° 30', 

tj — ij — — 4". 



Tiic general problem of interpolation consists, then, in representing a 
function, known or unknown, in a form ihosen in advance, with the aid 
of given values which this function takes for definite values of tbs s&d«* 
ppiKltfiit larmbic 

* lliue, let be a fumtion given by the values yt,yi,y» y* 

whuh It takes for the values a«, t„ Xt, x» of the >nde)vendeni variable x, 
and ](t 4(x) denote an arbitrary aimplcr function so constructed that it 
takis tlio same values os f(x) for the values x»,x„x„ x„ Then if 
/(r) 18 TOplaicil by <fi(z) over a given intervol, the process constitutes 
X^inlrrpolutioii, and the function ^(x) is a formula of interpolation 
r The function 4 (x) can take a variety of forms When ^fg) is a poIy« 
^ honiial the PTOcc^a ot re|iTp.a^iii{» 7 Xi^^ called parabolic OT 

itolynotmal iiiteniolatioii . and when ^(x) is a finite trigonometric senes, 
the process is trigonometric interpolation In like manner, ^fx) may be 
a serjcs of evtionential iunctwiis. Legendre polvnomiah, Bessel functio ns. 
et(- In practirM problems we alleys choose for the simplest func 

tinii^linli viiH reprfsriil the tfiven fumtion oier the interval ui question 

Siin-o iiplynoTnials arc the simplest fonctiona, we usually take a polynomial 
for ^(x), an d iicarly all the sternla rd formulas of i nterpolation are poly 

* The aiitli ir think* that Unit pruceM of replacing a complicated fuDctioa by a 
simpler one «hi uid be called the principle of aeaijrlieat repUcemiitl or the principle 
o( functMoal suhtlitvlMit 
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Homial foriuulas .l In case the given function is known to be periodic, 
however, it is bettor to represent it by a trigonometric series. 

The justification for replacing a given function by 'a polynomial or by a 
trigonometric series rests on two theorems proved by Weierstrass * in 1885. 
These theorems may be stated as follows : 

I. Every function which is continuous in an interval (a, b) can be repre- 
sented in that interval, to any desired degree of accuracy, by a polynoniial; 
that is, it is possibkrto find a polynomial P(x) such that | f(x) — P(x) | < e 
for every value of x in the interval (a, b), where t is any preassigned 
positive quantity. 

II. Every continuous function of period Zjt can be represented by a finite 
trigonometric series of the form 

ff(x) = flo + a-i sin x -j- 02 sin 2x • • • -j- ftn sin ux 

-j- b, cos X -f- b" cos 2x -}- ■ • • + b„ cos 7ix ; 

or 1 /( 1 ) — 9 {x) \ < S for all values of x in the interval considered, where 
S represents any preassigned positive quantity. 



or a finite trigonometric series whose graph remains within the region 
bounded by y =/(x) -{- 1 and y = /(x) —t for all values of x between a 
and b, however small t may be. («ec Kig. i.) Tliese theorems mean, 
therefoiv. tliat the given function may be replaced by a polynomial or bv a 
finite trigonometric scries to any desired degree of accuracy. 

• Cher ,lic anahjiischc Darstcllbarkcit soycna, inter xciltkiMichcr Fuuktionen eincr 
reeten Vcriiiitlcrlicftcn (.Sitzungsberidite di*r Kgl. Ak. der Wis.s., 18S5). 
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16 Differences If y„y«, y« denote a set ol values of any fun^ 
tjon y — f(i), then yi — y.,y,-'yiiy» — y«. y» — y» i are called the 
first differences of the function y Denoting these differences by Ay^,, 
Ayi, Ayi, etc , we have Ay, — y, — y«. Ay, — y, — yi, Ay, , — y, — y, i, 
Ay, — y,.i — y. 

The differences of these first differences are called second differences 
Denoting them by A’y,, A^yi, etc, we have 

A»y» — Ay, — Ay, — y» — 2yi + y», 

A’y, — Ay,— Ay, — y, — 2yi + y., 
etc 

In like manner, the third di^erences are 

i*y, — A’y, — A’y, — y» — 3y, 4- 3y, — y„ 

A‘y, — A’y, — A’y, — y. — 3y» + 3y, — y„ 
etc 

The following difference tabh shows how the differences of all orders 
are formed 

0 tl A'y o» y AV A*y a»y O’y A’y 

y< yi 

Ay, 

fi If, AVt 

Ay. 

y. y. A'jf. 

ay, 

y, y, A’y, 

Ay, 

4y. 

*, V. A’y, 

Ay, 

». y> A’y, 

Ay, 

«■ y, A’y, 

Ay, 


Tabu 1 DispniBl Diffcrenee Table 

This table is called a diagandl difference table The majority of dif- 
ference tables are of this kind, bnt for many purposes a more compact 
table, called a komontaJ difference table, is preferable In the horizontal 
difference tables the differences of different order are denoted by subaenpta 


A’y. 

A’y. 


A’y. 

A’r, 


A’y. 

A’y, 
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instead of exponents. Using the notation for horizontal differences, we can 
rewrite the preceding difference table in the horizontal form as follows : 


/ 


m 

V 





Ai» 

A,y 

A,y 

Aiy 

ect 

Vi 









ff, 

Vi 

A,y, 








*1 

Vt 










Vi 









a. 

Vi 



A,y4 

A,y, 






Vi 

A,y, 


Ao;, 

A<yt 

AiVi 




Si 

y* 



Aj^, 


A^r. 

A.y. 




Vt 

A,!/, 

^>yi 

Aa/, 

A4y, 

A»y, 

AiV, 

A,y, 



Vt 

A,y. 

A,y. 

A,y. 

AtVi 

A,!/, 

A^y, 

A,y. 

AiV, 


Table 2. Horizontal Difference Table. 


In order to see the relation between horizontal and diagonal differences 
of the same order, we give in Tables 3 and 4 the differences of both kinds 
in terms of the y’s. 

Inspection of these tables shows that the top diagonal line is the same 
in both, but that the bottom upwardly inclined diagonal in Table 3 is the 
same as the bottom horizontal line in Table 4. Also, from Table 3 we have, 
for e.xample, 

«=" ^4 — Sys + 3^2 — y,. 

Likewise, from Table 4 we have 


Ajyi = y* — Sya 3yj — y,. 

Hence 

A’yi -= Ajy*. 

A glance at Tables 3 and 4 will show that the general relation between 
the A’s affected with exponents and those affected with subscripts is 

A^yt *=■ Amyt^m (going forward from y*), 
or 

Amyn “ A^yn.p, (going backward from yn), 

where m denotes the order of differences and k and n the number of the 
tabulated value. 

The relation between diagonal differences and horizontal differences 
can be illustrated still further by a numerical example. The tables on 

page 51 show both kinds of differences for a set of equidistant values of 
the function y — sinh x. 


— 4yi+6!«— V +1' 
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z 

y 

Ay 

A*y 

A»y 

A<y 

A‘y 

A*y 

1.5 

2.12928 

24629 






1.6 

2.37557 

2.7006 

2377 

271 




1.7 

2.64563 

29654 

2648 

297 

26 

3 

1 

1.8 

2.94217 

32599 

2945 

326 

29 

4 


1.9 

3.26816 

35870 

3271 

359 

33 



2.0 

3.62686 

39500 

3630 





2.1 

4.02186 








I 

y 

Au/ 

A,v 

£kj/ 

Aj/ 

Aj/ 

Aty 

1.5 

1 2 12928 



1 




1.6 

2.37557 

24629 






1.7 

2.64536 

27006 

2377 





1.8 

2.94217 

29654 

2648 

271 




1.9 

3.26816 

32599 

2945 

297 

26 



2.0 

3.62686 

35870 

3271 

326 

29 

3 

> 

2.1 

4.0?186 

j 39500 

3630 

1 359 

33 

4 

1 


It will be observed that the differences for the seven functional values 
are the same whether written as diagonal differences or as horizontal 
differences. 

In certain work, however, . horizontal difference tables have distinct ad - 
yantni i cs. In the nur gp^'^”! -^^hifinr^ pf diffe rential equations, for example, 
the functional values behind us are always known, but those ahead of u s 
arc always unknown. Here the horizontal difference table shows all orders 
of differences on the same line as the last known value of the function, and 
these differences are used for finding the next computed value of the func- 
tion. The horizontal type of difference table is more compact and con- 
venient in this case than the diagonal type would be. 

On th e other hand, when we take up the s tudy o f central-difference inter- 
p olation in Clianter IV. wc shall find that a iliagonnl difftM-ence table is 
iiiiu-h better for tliat ])itr}iosc. 
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17. Effect of in Error in a Tabular Value. Let y», y„ y,, * y, be 
the true ralues of a function, and suppose the value y, to be aBected with 
an eiToi t, so thbt its erroneous value is yt + < Then the successive 
differences of the y's are as shown below 


S’ 

Ay 

AV 

AV 

AV 

Vi 

Ay. 




yi 

Ay. 

AV. 

AV. 


y. 

Av, 

AV. 

AV. 

AV. 

y> 

Ay> 

AV. 

AV. + « 

AV. + * 

y^ 

a». + « 

AV. + * 

AV. — 3* 

A.y, — 4« 

y. + * 


AV. — *« 


AV. i «• 


Ay.-# 


AV. + 


y< 

Ay. 

AV. + « 

AV.-» 

AV.— <« 

yi 

Ay, 

AV. 

AV. 

AV. + • 

f* 

Ay. 

AV. 

AV. 

A'y. 

y. 

Ay. 

AV. 




U 


Tabu 5 Showiog the elTeet of aa error in the tAbuUr ealuea 
This table shows that the effect of an error increases with the succesaire 
diBerences, that the coefficients ol the e^a are the bmomial coefficients with 
altematuif signs, and that the olyehrutcsuw of the tmrs \n any differenct 
column ts ten It shows also that the mortmum error tn the differences 
u >rv (he same homonlol (me as (he erroneous tabular value 

The following table shows the effect of an error in a horisootal difference 
table 


y 

A,y 

Ad. 

AdT 

Ad 

. 

y. 






y. 

A.y, 





Vt 

Ajr, 

A.y. 




y. 

A.y. 

Ad>. 

AdT, 



y. 

A.V. 

Ajr. 

Ad. 

Ad. 


y. + . 

Ajr.-f f 

Ad-. + r 

Ad. +« 



y. 

AAf.~« 

Ajy. — ^ 

Ad. — 3< 

Ad. — 4* 


y. 

Aj., 

A,y, + . 

Ad. + 3* 

Ad. + e« 


y> 

A.y, 

Ad, 

Ad. — * 

Ad, — At 


y. 

Aat. 

Ad. 

Ad. 



v« 

Aaf« 

Ad,. 

Adw 

Ad. 



Taiu a 


Art. 17] 


ERRORS IN TABULAR VALIAS 


53 


Here, again, the effect of the error is the same as in the preceding table, 
but in this table the first erroneous difference of any order is in the same 
horizontal line as the erroneous tabular value. 

The law according to which an error is propagated in a difference table 
enables us to trace such an error to its source and correct it. As an illus- 
tration of the process of detecting and correcting an error in a tabulated 
function, let us consider the following table ; * 


X 

y 

All/ 

All/ 

Aslj 

Aty 

1 

€ 

0.10 

0.09983 





\ 

0.15 

0.14944 

4961 





0.20 

0.19867 

4923 

- 38 




0.25 

0.24740 

4873 

- 50 

-12- 



0.30 

0.29552 

4812 

- 61 

-11- 

1 


0.35 

0.34290 

4738 

- 74 

-13 

- 2 


0.40 

0.38945 

4655 

- 83 

- 9 

4 


0.45 1 

0.43497 

4552 

-loa. 

-20 


-4* 

0.50 

0.47943 

4446 

-106 

• - 3 


6e 

0.55 

0.52269 

4326 

-120 

-14 


- — 4« 

0.60 

0.56464 

4195 

-131 

-11 

HB 

c 

0.65 

0.60519 

4055 , 

-140 

- 9 



0.70 

0.64422 

3903 

-152 

-12 

BBI 



Here the third differences are quite irregular near the middle of the 
column, and the fourth differences are still more irregular. The irregularity 
begins in eaclf column on the horizontal line corresponding to s «= 0.40. 

Since the algebraic sum of the fourth differences is 0, the fourth dif- 
ferences found in this example are accumulated errors. Eeferring now to 
Table 6, we have 

— — 11, 6e = 17, etc. 

Hence, £ = 3 to the nearest unit. The true value of y corresponding to 
a:«= 0.40 is therefore 0.38945 — 0.00003 = 0.38942, since (yjt -}- e) — c — yt. 
The columns of differences can now be corrected, and it will be found that 
the third differences are practically constant. 

If an error is present in the data, the differences of some order will 
become alternating in sign. Carry the differencing far enough to allow 
the error to be revealed in this manner. 


• you. wiit-n wi itin" numericnl difference tables, or when substituting numerical 
differences in iormulns, it is customary to omit the zeros between the decimal point 
and the first significant figure to the right of it; in other words, the differences are 
expressed in units of the last figure retained. Thus, instead of writing —0.00038 as 
the first number in the column A.y we write simply —38. This practice will be 
followed throughout this book, except in a few instances where the zeros are written 
for the sake of clearness. 
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If several tabular values of the fonction arc affected with errors the 
successive differences of the function wilt become irregular, but it is not 
an easy matter to determine the sources and magnitudes of the separate 
errors 

In the case where each of the tabulated p’s is affected with an error 
of magnitude «, each of the third differences is affected with an error 
(» — 3a I + 3(t I — a I, each of the fourth differences with an error 
» — 4o t + 1 — 4a 1 -f* < 1 4> etc , as is evident from Tables 3 and 4 

In practical problema the tabulsted values of the function y are obtained 
by measurement or by computation They are thus liable to be affected with 
errors of measurement or with errors due to rounding off the computed 
results to the given number of figures In either case these errors would 
be magnified in the process of taking differences and they alone would be 
sufficient to cause the higher differences to become irregular* For this 
reason it is usually not advisable to use differences higher than the fourth 

18 Relation Between Differences and DeriTatlTcs It is sometimes 
desirable to know the relations which exist between differences and deriva 
tives The fundamental relations between them are 
(ID 1) AV(*) — (* + 0 < 8 < 1 

and 

is 74^ 

These relations are derived ki ValI4e Poussin’s Cours d Analyse Jnfintlest 
male, I (fourth edition, 1921), pp 72 73 

V19 Differences of a Polynomial Let us now compute the successive 
differences of a polynomial of the nth degree We have 

( 1 ) y — /(x) •-ox" + Jz*-* + cx« * 4 - 4 - 1 * 4 .! 

(2) y + Ay — «{x 4 - A)* 4 - b(x 4 - A)« * 4 - c(x 4 - A)-» 4 - 

4-fc(x4-A)4-», 

where A — Ax 

Subtracting ( 1 ) from (2), we get 
Ay — o[tx4-A)'‘ — x-*] 4 6[(x4-A)- >] 

4-e[(x4-A)- * — *••]+ +itA 

• For an ezhauatlTc diuuuiaii ot errma l« the tabular va1>\es of a {unelion, tea 
Riee’t ThtDrii and Proc/ice of Interpotatum pp I 15 and 48 82 Also 0 Biermton’i 
ForIs*«np«n iber Ifatkemaliteke Niker^nfUnttkoden, p 138 
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Expanding the quantities + etc. by the binomial 

theorem, we have 

Ay - a [y'+ nAa:"-' + A*®"-" -f 

+ a:"J + 6 [*"-" + (n— l)Ai''-=' + (n— iHn- ^ ) 

4. . . — 4. 0 j^a:»-a 4. (n — 2 )Ai’'-» + (** — 

4. . . ■ — 4- ... 4- Jch, 

or 

Ay =. onAa;'’"* + j^“A* J ®"*' . 

4. a:"-® 4 - * ’ 

Now if Aa:(= h) is constant, the bracketed coefficients of a:""®, a:"'®, etc. 
are constants, so that we may replace them by the single constant coeffi- 
cients 6 ', c', etc. Hence we have 

(3) Ay •= anhx”'^ -f h'x’'~* -f- c'aj"** -f- • • • -{- h'x -^V. 

The first difference of a polynomial of the nth degree is thus another poly- 
nomial of degree n — 1 . 

To find the second difference we give x an increment Ax = A in (3) 
.and therefore have 

(4) Ay 4- A (Ay) = anh{x 4* A)"'‘ 4" A'(x-t- A)""® 

4 - (f{x 4 - A)"-® + ' • • + k'(x -f A) 4 - V. 

Subtracting (3) from (4), we get 

A (Ay) =»A®y>= ttnA[(x 4 - A)"'® — x"'®] 

-fA'[(x4-A)'-® — x”-®] -fc'[(x-f A)"-» — x»-®]-)-- • --f A'A. 

Expanding (x-j-A)"*®, (x-f-A)"*®, etc. by the binomial theorem and re- 
placing the constant coefficients of x"-*, x”"*, etc. by a single letter as 
before, we have 

A*y — . cn(»i — 1 ) A®x«-® 4 - A"x"-» 4- c"x"-‘ • • • 4- fc"x 4. I". 

The second difference is thus a polynomial of degree n — 2. 
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Bj contiDuiQg the calculation in this manner ve arrive at a polynomial 
of zero degree for the nth difference, that u, 

A*y — a[n(n — 1) (» ~ 8) — an lA"!® — aA"n ! 

The nth difference is therefore constant, and all higher differences are zero 
The reader should hear in mind that this result is true only vhen A is a 
constant, that is, when the values of x are in arithmetic progression 
The proposition which we hare just proved nay he stated as follows 
Tk$ alh dtfftrtneii of a poli/nomuU of iho nlA decree ere constant toAen 
<Ae values of <Ae independent tanahte are taien in antAmetie progressum, 
<Ad< u, at equal tntercale apart 
The converse of this proposition is also true, namely 
If (Ae ntA differences of a tabulated /unction are constant tcAsn tAe ratue; 
of (Ae independerU I'anaite are tatieRtnantAmetie progression, the function 
M a polynomial of degree n * ^ 

This second proposition enables ua to replace any function by a poly 
nemial if its differences of some order become constant or nearly sa Thus, 
the function tabulated m Art 17 can be represented by a polynomial of 
the third degree, since the corrected third differences are approximately 
constant 

SO^Tcwtoa’s Formula for Forward Interpolation Our next problezdl 
is to find suitable polynomials for replacing any giren function over al 
given mterval Let y — /(x) denote a functioo which takes the vainest 
y»>yi>yt> y» for the equidistant values 7,,x„x,, z« of the mde-l 
pendent variable t, and let ^(x) denote a polynomial of the nth degree J 
This polynomial may he wviUen in the form 

(1) ^(x) — «4 + 0 ,(l— I,) +tf,(x— x,)(x — Xi) 

+ 0, (x — X,) (X — X,) (x — I,) 

+ o,(x— x,)(x— x,)(x— x,)(x — x.) 

+ +0-(*— *.)(* — x,)(x — 2,) (2— I,ui) 

We shall now determine the coefficients ao,ai,a,, a, so as to make 
<^(xa) — y„ ^(x,) — y„ ^(x.) — y„ ^(x.) —y. 

Substituting in (1) the successive values z„x„z,, x, for x, at 
fhe same time putting <plx,'} — y,, ^(x,) — y„ etc , and remembering that 
I, — X, — A, 2 , — Xo “"2A, etc, we have 

• For the proof of thU propotition lee Ruses Theory aed Practice of Interpotalton. 
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yo “ Oo) or Oo J/o' 
yj «“ Oo “}“ fli (®i — ®o) yo 
• „ yi — yo Ayo 

f/j Qo *i“ (xj •" Xq) “I" fla (xj Xo) (Xa yo “f 

(A) • 


yi— yo 


(2ft) 


a,— 


ya— 2 yi + yo ^*yo 


2 ft» 


2ft* 


y» flo ”1" fli (®3 — ^o) “}■ 02(2^3 — 
+ Oj (xa — Xo) (Xj — Xi) (x* 


iro) i^s ■ 

— X 2 ) 


■yo + 


yi— yo 


(3ft) 4- 


Oj 


y3— 3y2 + 3yi — yo 


ya— 2yi + yo 

2ft* 

A*yo 


■Xi) 


(3ft)(2ft) +a,(3ft)(2ft)(ft). 


6 ft* ~ 3 1ft* ‘ 

y 4 “= 00 + 01(2:4 — 2:0) +a2(x4 — Xo)(x« — X,) 

+ a2(2:« — Xo) (x« — Xi) (xi— X2) 

+ a«(x 4 — Xo) (X4 — Xi) (X4 — Xj) (xi — X,) 

yi 

2ft* 


■yo+' 


y£(4ft) + y*-|f i. ± -. y i(4ft)(3ft) 


0,- 


+ 

y<' 


ya — 3y2 + 3yi — yp 

6ft* 

— 4yo + 6 yi — 4yi + y^ 
4!ft‘ 


(4ft) (3ft) (2ft) +a«(4ft)(3ft)(2ft)(ft). 

A*yo 
’4!ft« ' 


By continuing this method of calculating the coefficients we shall find that 
A»yo „ A®yo _ _ . „ A"yo 


Os' 


5!ft»’ ®°‘“ 6 !ft«’ “'"■“nlft"’ 

Substituting these values of ao, Oi, • * ’On in ( 1 ), we get 

( 2 ) <f>(x) =.yo+^(x — Xo) +^j^(x — Xo)(x — Xi) 

flft^^® — Xo) (x — Xi) (x — X,) 

+ 4 1^4 (® Xp) (x Xi) (x Xj) (x Xs)+* • • 

n Ift" ^ 0 ) (x Xi)(x X 2 ) • • • (x Xn-i). 

This is Newton’s formula for forward interpolation, written in terms of x. 


a„ < 
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The formulft can be simplified a chsnge of variable Let us f rsl write 
(2) in the following equivalent form 

(3, + 

Now put 

or * — i, + h« 

Then since Si ^ x« + K + 2A, etc , we have 

x — Xt J— (J«+A) x—x,~h g— g, k , 

A” A "" A — A A 

z — g« g— tg. + 2A> „u_2 


g — zw-i z— [g,+ (ft — 1)A1 _ g--g» __ (n— 1)A 
n + 1 

Substituting in (3) these values of {x — g«)/A, (g — gi)/A, etc, we get 

(I) ^ (I| — ♦(». +»u) — ,(») — a’y* 

+ I “(■■— 3)(»— 3)^ + 

This » the loim in which Newton’s formula for forward interpolation 
18 uanally written We shall refer to it hereafter as Newton’s formula 
(I) * It will be observed that the coefficients of the A’s are the binomial 
coefficients. 


* Recent Uitoneal Inveellgation ha* •hewn that this formula waa really firet dii 
covered hy Jcmee Gr^ry aa early as IS70 
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The reason for the name “ forward” interpolation formnla lies in the 
fact that the, formula contains values' of the tabulated function from i/o 
onward to the right (forward from yo) and none to the left of this value. 
Because of this fact this formula is used mainly for interpolating the values 
of y near the leginning of a set of tabular values and jfor. extrapolatin g 
values of y a s hort distance backward (to the le ftl- from yp. ^ 

The starting point y© may be any tabular value, but then the formula 
will contain only those values of y which come after the value chosen as 
starting point, 

21.' Newton’s Formula for Backward Interpolation. The formulas of 
the preceding section can not be used for interpolating a value of y near 
the end of the tabular values. To derive a formula for this case we write 
the polynomial xj)(x) in the following form: 

(11 «f>(x) =0^4- €li(x X„)+a2(l X«)(X Xn-i) 

+ a,{x Xn) (i — x„.,) (x — 

-fa<(x — Xn)(x — — In-,) -J- • • • 

4-an(l — In) (l — In-i) • * * (l Ii). 

Then we determine the coefficients a,, tt,, o,, • • • On so as to make ^(i„) == y„, 
^(in-i) = y„-j, etc. Substituting in (1) the values x^, Xn-i, etc. for i and 
at the same time putting i^,(i„) = y„, <{>{x^.^) == y„-i, etc., we have 

yn '= Ooj or flo •= yn . 
y»-i = Oo4-Ci(i„-i — Xn) =yn + ai( — h). 

• _ Vn yn-1 ^lyn 

• yn-I *= Oil -f ai(Xn-3 In) a-(ln-; In) (l„-. In-,) 

•= y„ + 2/;) -f o, (— 2h ) (— ii ) . 

• a yn — 2yn-t -f yn-, 

■ ‘ ^ 2 h- ' 

By continuing the calculation of the coefficients in this manner we shall find 


a, =. 


AiVn 

3lk^' 


a. 


A<y» 


fln = 


Any« , 
nlh” ' 


Substituting these values of Oo,a„a,s etc. in (1), we have 
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+f]|r(^ — JT.) (X— X-i) (X—X».j) 

+ff7(* — + 


+^(* — JC-Xa:— *. i) (x — 1<) 

This IS Newton’s formula for iociioari interpolation, written in terms 
of X It can be simplified by making a change of ranable, as was done 
m Art. 20 

lict us first write (2) m the cqniralent form 

(^) 

Now put 

u — * ^ , or * — X, 4- h**- 

Then since x, i —x, •— A, x, , — x.— 2A, etc, we bare 

X — X, t X — (x« — A) X — x»4-A X — , A , 

k ~ k ~ k “*+* — X + J. 


I — ii I— [i.— (n — 1)»] X— *. . (n—l)k 
k k J~ + * « + »— 1 

Substituting m (3) these >alae8 of (r — Xm)/h, {x — x, i)/A, etc , we xet 

(II) ^(x) — ^(i> + Au) — ^(u) — y, + uA.y, + + 1) 

, «(tt+l)(u+2) . . «(u + l)(u + 2)(u + 3) . . 

+ ^ 3l + 41 ^- + 

, ti(u + l)(« + 2) (u + n— 1) . 

+ ^y.. 
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TMs is the form in ■which Newton’s formula for background interpola- 
tion is usually written. We shall refer to this formula hereafter as Newton’s 
formula (II). It is to be observed that this formula employs horizontal 
differences, whereas the formula for forward interpolation employs diagonal 
differences. 


(II) is called the formula for “backward” interpolation because it con - 
t ains v alu es of the tabulated function from v„ backward to the left and non e 
to th e right of Wn. T his form ula is used mainly for interpolating values 
of y near the end o f a set of tabular values, and also for extra])olating values 
of y a short distance ahead (to the right) of Vn. ^ 

We shall now illustrate the use of Newton’s formulas by working some 
examples. 

Example 1. Find logjoff, having given 

^ .s log 3.141 = 0.49'?0679364, 

•i t log 3.142 = 0.4972061807, 
log 3.143 = 0.4973443810, 
log 3.144 = 0.4974825374, 
log 3.145 0.4976206498. 


Solution. We first form the table of differences, as shown below: 

A*y 


X 

y = log X 


A'y - 

■3.141 

0.4970679364 





1382443 


■ 3.142 

0.49720G1807 

1382003 

— 440 

^143 

0.4973443810 

1381564 

— 439 

3.144 

0.4974825374 

1381124 

— 440 

3.145 

0.4976206498 



Here 

=> 3.1415926536, 

Xo == 3.141, h 

= 0.001. Hence 


1 

■1 


X — x* 3.1415926536 — 3.141 
„ ^ _ 0.5926536, 


h 0.001 

« — 1 = ~ 0.4073464,' etc 
Substituting these values in (I), Art. 20, we get 






-R/ 
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— 0 49706793M + 0 5926536(7382443) 

0 6926536(^0 4073484) (— 440 ) 

2 

— 0 49-0679364 + 0 0000819310 + 0 0000000053 

— 0 4971498727 

This result is correct to its last figure 

^ Exum'plt 2 Using the tabular values of the preceding example, find 
logic 3 140 

Solutvoft Here * — » 1 —3 140, 2,-3 HI, h —0001 Hence 



«— 1—2. etc y 


log,, 3 140 — 0 4970679364 + (— 1)(1382443> -f — ^(_440\ 

— 0 4970679364 — 0 0001382443 — 0 0000000440 

— 0 4969296481 

This result is also correct to its last figure 
Npte The process of computing the value of a fuoctioa outside the 
range of girea values, as m the example above, is called eztrapolaticn 
It should be used vith caution, but i{ the function ta hnovrn to tun 
smoothly near the ends of the range of given values, and if h is taken as 
small as it should be, ve are usually safe in extrapolating for a distance 
A outside the range of given values 

Example S The hourly dechnatiou of the moou for January 1, 1918, 
IB given in the following table Find the declination at 3^ 35" 15* 


Hwi 

pedinaltoa 

1 



0 

1 

2 

3 

■*^4 

8* 29 63' 7 

8 18 19 4 

8 fi 43 6 

7 65 6 1 

..JJL12K 

1 

-ll* W' 
-11 35 

-11 37 

3 1 
9 1 

-l' 6 
-1 6 1 
-1 

O' 1 
. « 


iSoluIioo, Since the desired decimation is near the end of the values 
given we use Newton’s formula (11), and we therefore form a horizontal 
difference table, as shown above Penotisg the time in hours by t, we 
have <» — 4, t — S'* 35“ 15», A — 1 Hence 
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t~U — 0'>24“45» —1485* 

A “ 1»» 3600» 

« -f 1 = 0.6431. 


0.3569. 


Substituting these values in (II) and denoting the required declination 
by 3, we get 

S ^ 7° 43^ 27".2 + (—0.3569) (— 11' 38".9) + - i (— 1".5) 

— 7° 43' 27".2 + 4' 9".4 + 0".2 
»-7°47'36".8. 


Example Using the data of the preceding problem, find the declina- 
tion of the moon at < «=« 5**. j 

Solution. Here t =» in*i = 5, <„ = 4. 


u ■ 


tnti t 


n 4 I -I 

= "T” “1* U 1 
it 


Substituting in (II), we have 

r 43' 27".2 4- (1) (— 11' 38".9) + (— 1" 5) 

7° 31' 46".8 . 

The true value, as given in the American Ephemeris and Nautical Almanac, 
is 7° 31' 46".9, the eiTor in the extrapolated value thus being only 0".l. 


EXERCISES n 

1. Find and correct by means of differences the error in the following 
table: 

20736 

28561 

38416 

50625 

.65540 

83521 

104976 

130321 

160000. 
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2. Correct the error in this teble: 

19“ 12' 22".4 

19 25 54 .7 

19 39 7 .3 

19 61 63 .8 

20 4 31 .9 

20 16 43 .5 

20 28 34 .3. 

3. Find logia flin 37' 23", giren 

log sin 37' — 8 0319195 — 10 
“ " 38' — 8 0435009 — 10 
" « 39' — 80547814— 10 
“ « 40' — 8 0657763 — 10 
“ " 41' — 80764997 — 10 
« « 42' — 80869646 — 10 
“ “ 43' — 80971832 — 10. 

4. The following table gtres the longitflde of the moon at twelre'liour 
intervals for the first four da>8 of April, 1918 Find the moon’s longitude 
at 8 60 p K on April 2, the daj beginning at noon. 


Apr. 1 

0 

244* 

44' 

20".5 

“ 1 

12 

250 

67 

35 .7 

« 2 

0 


14 

22 .1 

“ 2 

12 

263_ 

35 

8 .6 

“ 3 

0 


0 

24 .6 

“ 3 

12 

276 

30 

39 .6 

" 4 

0 

283 

6 

22 .1. 


5. Ijeing the data of Exercise 3, find log»in42'13". 

6. Using the data of Exercise 4, find the moon’s longitude at 8.43 
p ir., Apr. 3 



CHAPTER III 


INTERPOLATION WITH UNEQUAL INTERVALS 
OF THE ARGUMENT 

Divided Differences. The interpolation formulas derived in the 
preceding chapter are applicable only when the values of the functions are 
given at equidistant intervals oi the independent variable, or argument. 
It is sometimes inconvenient, or even impossible, to obtain values of a 
function at equidistant values of its argument, and in such cases it is 
deMrable to have interpdation formulas which are applicable when the 
functional values are given at unequal intervals of the arg ument. Two 
such formulas are Newton’s formula for unequal intervals of the argumen t 
and Lagrange’s formula. The former employs differences, but the latter 
does not. The differences used in t he Newton formula are called divided 
^ erences. w hich are differences obtained in the usual manner and then 
divided by certain differences of the argument. Hence the name. 

Let y(),yi,y3,- * -yn denote functional values corresponding to any values 
• • -in of the argument. Then the divided differences of y in 
ascending order are defined as follows: 

First order divided differences: 


Xi — Zo — Si Xs — X, 


Second order differences: 

^(Xj, Xi^ ^(Xi, Xq) 

S(x«,Xi)— 8(xt,Zi) 
x«— Xi 


• S(x2, Xi, Xo') 
.8 (xs,X 2 ,Si) 


etc. 

Third order differences: 

S(Xg, Xa, Xi) ^(Xi, Xi, Zq) 

Xo 

S(x«, Xa, Xi) — S(xa, Xj, Xi) 

Zi — Xi 

etc. 


= 8(xj,a:-,x„Xo) 

• Xj, Xj, Xj) 


Fourth order differences: 

^(^ 4 > Xg, Xi, 3*1) ^(xg, X2f Xi, Xq) 


Xj— Xo 


‘ Xj, Xj, Xj, Xo) 


etc. 
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N'ote that the order of anj tlivided difference is one less than the number 
of values of the argument m it 

If *** points on a curve, the first-order 

ilinded difference is the *Jope of the secant line through any two points 


23. Tables of Divided Differences Tables of dnided differences are 
shorn below. 


— — 






* 






•t 

Vt 



- 



Vi 



81#, a„s, s«l 


•» 

y> 


«(». A *.) 

»<».. •* «il 



v> 

Me; 





*<». *•! 


((*, a. 



v< 


<(e. '»«>•) 

8(r,»,.r..r,) 

8 

•l 

Vt 

t(c«e4l 




«• 

V* 
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The second entry in the 8®-colunm above, for example, was found as 
follows: 

60 

6 — 0 

For the first entry in the 8‘-colunm we have 

-9-18 o 

7- (-2) 

The other entries were found in a similar manner. 

y 24. Symmetry of Divided Differences, Divided differences are sjun- 
metric functions of their arguments, as indicated below for particular cases. 


8(®i,a:o) = 


Also, 


Hi— Vo yo—yi 


Xi — Xo 


S(xi, Xo ) . 
S(a;j, Xi, X)j) I 


yi _ yo 


Xo — Xi 

Vi 


■ 8(a:o, Xj) 


+ 


yo 


" “ CCq CC\ — Xq —— 

8(1;, gl) S(Xt, gp) 

2/2 ' ' ' ^0 


[: 


ys 


+ 


yi 


X2 — Xo LiCj — 2:1 ®i — X2 


(i, 


yi 


+ 


yo 


a^o Xo — Xi 


)] 


-l-r-^+yJ-±- y^l 

X3 ** Xo L-X2 Xj \*^l ' X2 Xi Xq / Xo x^ J 

^2 I yi ) yo 

(Xa--Xo)(x2 — Xi) (Xi — Xo){Xi — X2) {Xo — X2){Xo — 


K^Z, Xt, X 2 , Xo) — 

Xj •—“ X(i 


h ;[: 


y» 


+ 


y* 


(Xo—Xi)(Xo — X2) ^ {X2—Xl)(X2 — Xo) 


yi 


-G 


yo 


{Xy — X 2 )(Xi — Xi) \{Xi — Xo){X 2 — Xt) 


+ 


yi 


+ 7- 


yo 


(®i — 2:o)(a:i — x^) (x^ — Xi)(X| 


j— Xj))l 


Xt 


:b:[ 


y» 


(Xj— Xi)(a-3— Xi) 


■yz 


( 


(Xj — Xi)(x2 — Xa) 


(Xj — Xo)(x2— ((Xi— X2)CXx. 


(® 1 — Xo)(x, 


)(x,— Xj)) 


yo 


(So— Xl)(Xo — Xj) 


•Xj) 

•]- 


Xa) 
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or 

i(i„ I., a:., X,) - 

, yi 4. Vl 

"** (li — »«)(*| — — **) ^ (Xt~Xi)(Xt — Xt){Xt — X,) 

Tbe right hind members of the ebove equations remain unchanged Then 
anj tvo values of x are interchanged and the corresponding y’s are also 
interchanged Thu means that a dinded difference remains unchanged 
regardless of hoT much its arguments are interchanged. Thus, 

«(1, 6, 9) — J(C, 9, 1) — «(1,9, 6) — «(5, 1, 9), etc 


We ma; therefore vnte 


etc 


It can be proved b; mathematical mdnction that 


( 211 ) 


i! 

(*—».)(«— *1) 

(* — **) 

y» 


(*,— — T.) 


y> 


(*,— *)(r,— r,) 



4. & 

25 Relation Between Ptrlded Piffeieacea and Simple Differences. 
The relation between divided differences and simple differences can be 
found by startmg with a set of functional values corresponding to equi 
•iarfaoh, -nZftnfb Ul *£111! vtigumei h , cpnritrndtmg a N^e ot simjfie iiSerences 
and a table of divided differences of these functional values, and then 
comparing differences of the same order in the two tables For the simple 
difference table we have 
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9 

V 

Ay 

A*ir 

A*y 


a. 

Vo 







Vx — Vo 




Co+ A 

Vx 


Vt-ZVi + Vo 





Vo — Vx 


yi— 3y,+ 3t/i—ya 


*■5 + 2 A 

Vt 


Vo — ^Vt + Vi 


Vt — ^Vo + &Vo — ^Vi + Vo 



Vo — Vi 


Vo—3Vi+3Vs—Vx 


-f- 3A 

Vt 


Vo — ^Vi + Vi 


Vs — ^Vo + 6 y, — 4y, + Vx 



Vi — Vo 


Vo — 3yo + 3Vo — Vo 


«•»+ 4A 

. vl 


Vo-ZVo + v, 


y,—iyo + 6^4— 4y, + yi 



Vo — Vo 


Vt — 3ys + 3Vi — Vt 


e, + 55 

Vo 


Vo — ^Vo + Vo. 





Vt—¥i, 




c, + 6 h 

Vo 






And for the divided differences the table is : 


a 

n 

Sy 

tty 

tty 

5‘y 

ffo 

Vo 

Vx — Vo 





S((+ Jv 

Vx 

h 

% 

Vo — ^Vx + Vo 




Vi — Vi 

2h • h 

y. — 3y, + 3ya — yo 



r, + 25 

Vo 

h 

Vt — ^Vt + Vi 

35-25-5 

Vo. 

— 4y. + 6 yi — 4yi + y. 

Vt—Vi 

2h • h 

y. — 3y, + 3y, — yx 


45 • 35 • 25 • 5 

ro + 3A 


h 

Vt — ^Vt + Vo 

35 - 25-5 

Vt 

— 4y, + 6 y, — 4y, + yi 







Vi — Vt 

n 

y. — 3y. + 3y, — y. 


45 • 35 - 25 - 5 

•, + 45 

Vo 

h 

Vc — iVo + Vt 

35-25-5 

Vt 

— 4 y 5 + 6 y 4 — 4y, + y, 


immi 




Vs — Vo 

y. — 3y. + 3y, — y. 


45 • 35 • 25 • 5 

•. + 55 

Vt 

h 

il9BE9Efli 

35 • 25 ' 5 



Vo — Vt 

25 • h 






h 





e 4" 6 ^ 

Vt 

























70 


INTERPOLATIOV— UVEQUAL INTERVALS OF ARGUMENT" [C»a» III 


From these tables we see, for example, that 

i*y* «■ {(x# + 2^, x» •}• A, x») 

V4 — 4v» 4- 6v» — 4Vi + Vi 

" 41A* 4!A* 

and more generallj. 


(25 1) 


i«y»«-i<(ij4.nA,x*-f- (n-i--l)A, 

_ A*y> . 

n*A* ’ 


*» + *») 
0 , 1 , 2 , 


In Art. 19 it was shown that the nth simple differences of a polynomial 
of the nth degree are constant. Since (25 1) is an nth degree simple 
difference dirided by the constant pmdact nIA*, it follows that <As nth 
dtndid dtfftrences of a poli^nomutl of Ihe nlh dtgreo aft eonstant Hence 
lAe (n4'l)fA dmdtd d\gtrtnee$ of a polynomMl of t\t ntA degree are 
ttro 




pH 26 ^TTewtott*i General Interpototloa FomnU . Newton’s general inter- 
polation formoia tor unequal inteirals of the argument can be denred 
by starting with any ranable pair of raloes x and y and the pairs of giren 
raloes, wntug down the dinded differences m ascending order, and then 
soirmg for y in inocessire steps nntil as many terms as desired are found. 
Thus 




W «(®,x»,x,)— 5(x^x„x,) 

” — «(x, Xu x^) 

*>» »»» »•) 

W 5(x,x#,ii,i, Xi)— j(xo,Xi,Xj,i*,*4, ,, ^ 

■’ — 8(x, x„ x„ Xu Xu x«)n. 


I(x, Xu Xu j,) — 5(i„ Xu zu X,) 

X — X, 

5(x, Xq, Xit Xf Xf) ‘-^5(Xo,Xi,Xf,X4, X 4 ) 

X— X 4 

btx, Xq, X|,X», X|, X 4 *)— -?(x9,Xt,Xg,3?4,g4 Xi) 


X — Xi 


— 4(x, X*, x„ X,, x„ X4, X,) 


From (a), 
(g) 


y — ■ y. + (*— x^(x, lo) 
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Prom (b), 

5(x, Xo) “ 8(^t» 4* ®o> ®i)- 

Substitute into (g) this value of 8(a:,®o) and get 

(h) + — So) [8(iCo> ®i) + Si)8(s, Soj ®i) j , 

“™yo *i" (® — So)8(so)Si) 4“ — ®o)(® — Si)S(s, So> ®i)* 

From (c), 

S(s, Soj ®i) *=* 8(Soj ®ij *«) 4" (® — ®i, s*) 

Substitute this into (h) and get 

ymmy^ (a: — So)5(So)®i) 4~ (® — So)(® — Si) t8(xo, Sij Sj) 

4" C® — ®2)8(Sj iTo, Sjj Sj)J 

— yo4- (®— ®o)8(so,®i) 4- (®— So)(®— ®i)S(®o,Su®*) 

4” (®“~®o)C®T”®i)C®'^7~®s)8(S) So> Sij s*) 

From (d), 

8(®5 Sj, Sj) S(So, Sij Ss, Ss) 4* (® ®8)8(®, ®0> ®lj ®S> ®8) 

Substitute into (i) and get 

y — yo 4- (® — ®o)8(®o, ®i) 4- (® — ®o)(® — ®i)8(®e, ®i, ®*) 

4" (®*~®o)(®“’®l)(®~*®s)[^(®®> ®S>®8) 

( j ) 4- (® — ®s)5(®, ® 0 , ® 1 , ®*, ®«)] 

— yo4- (® — ®o)8(®0,®l) 4* (® — ®o)(®-— ® i)8(®c,®X,®2) 

+ (®— •So)(® — ®l)(® — ®2)8(®0,®1,®2,®*) 

+ (x— Xo)(®— ®i)(®— ®s)(®— ®»)!(®,®o,Si,®s,Si). 

From (e), 

8(®1 ®0> ®l» ®*j Ss) 8(®o> ® JJ ®»> ®8/ ®i) 

4- (® — ®«)8(®, S©, ®a, ®t, Tt, **) 

Substitute this into (j) and obtain 

(k) y — yo 4- (®-— ®o)S(®o, ®j) 4- (®— ®o)(® — ®i)8(®o, Su ®s) 

-f (® — So)(® — ®i)(®— ®j)S(®(„ ®1, ®2, Sj) 

•f (®— ®o)(®--®i)(®— ®*)(®— ®»)S(so,Si,®s, s,, ®«) 

+ (a;— io)(®— ®i)(®— ®,)(®— ®,)(®— ®.)S(a:,a:o,®i,®2,®„®4). 

By continuing in this manner, or by mathematical induction, it can be 
proved that the general Newton formula with divided differences is 
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(26 1) y-y, + (i—ro)«(*«,*») + (»— *•)<* — 

+ (x— *«)(*— + 

+ (x— xOC*—**) (*— sW-i)J(X|„Xi,3:„ *,) 

+ (*—x, )(*—*,) (x— a;,)8(r,r«,Xu**, *.) 

The last term in this fonnulA u th« remainder term after n + 1 terms, 
or Rati Hence 

(26 2) — (x— Xo)(x— *,)(x— x.) 

(X— X,)S(X,Xe,X„X„ Xa) 

Here it seems worthwhile to state that aU terns in the right hand 
member of (26 1} hare the dunensioiu of y, regardless of the nature of x 
and of the umts in which x is expressed x units or x-dimensions 
always cancel out For example, the second term in the right hand member 
of (26 1) u 


in which the x*<liaensioa in the anmerator cancels that m the dsnommstor 
The third term of (26 1) is 

[1(5..^^.^] 

^ (x— g,)(i— X,) r y»— y. _ yi— y<> ~) 

““ Xi— X* Lxj — x, X,— X»J 

Here the x*dimenaion is of the second degree m both numerator and 
denominator and therefore cancels out, tearing the term in the dimensions 
of y alone 

The disappearance of the dimensions of x in the terms of (26 1) means 
that X may be of any nature and expressed m whatever units may be 
required. The x’a require no transformation before substitution m (26 1) 

Example 1 The following ta'ole gires certam corresponding vidnes of 
X and logioX 


Find log 323 5 by Newton’s genera] formula (26 1) 
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w 

logs 



8« 

321.0 

2.50651 

0.00134444 

> 


'~322.8 

[‘2.50803 

0.00134286 

0.00133750 

— 0.09000158 

— 0.00000022 

324.2 

j- 2,51081 

— 0.00000244 

325.0 

2.61188 





Solution. Here Xo = 322.8, yo *=» 2.50893, g, ■= 324.2 , g; =■ 325.0, 
g-«» 323.5. Hence . ' 

log 323.5 = 2.50893-4- (323.6"— 322.8)(0.00134286) (?fXo/> » o X 2-). 

' ' ' ' -f (323.5 — 322.8)(323.6 — 324.2)(-^0.00000244) 

-= 2.60893 -f 0.000940 -{- 0.0000012 
=•2.50987. 

This result is correct to its last figure. ' 

h-tvJidli^ ' 

Example 8. Find esc 26''.167 by means of (26.1) and the following 
table. 


jr 

CSCff 


5 * 

S* 

25*.05 

2.3C178256 






— 0.087900126 




-25M3 .0 

'ht 2.35476007 


0.003613125 





— 0.087183500 


— 0.000141907 



‘J{ 2.34428805 


0.0035748105 




— 0.080504286 


— 0.0001476607 

25*.32 );-■ 

) 1-2.33823276 


0.0035351188 





-^0.085938667 



25*.41 ' V 

2.33049827 
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SoMun Here *g — 25* 13, y* — 2 3M75007, — 25* 25, x, — 25* 32 

Then from (26 1) we have 

CSC r — 2 35476007 + 0 037 (—0 0871836) 

4- 0 037 (— 0 083) (0 00357481) 

+ 0 037 (—0 083) (—0 163) (—0000147561) 

— 2 35475007—0 003225790—0 000010978 — 0 000000069 

— 2^5151323 ^ 

27. La^snge’s Interpolatlca FormcU. Let fix) denote a polynomial 
of the nth degree which takes the valnes y*,yi,yi, y« when x has the 
Zm reapectmly Then the (fl4'l)th differences of this 
polynomial are «ro (Art 25) Hence i{x,Xt,Xi,Xt, £,)— 0 and 
(24 1) become* 

-i . 2! 

(*—*«)(*—*,)(*— *i) (*— x.) ^ (x.— *)(».— X,){*.—J|) (*«—*.) 
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This is Lagrange’s formula and is seen to give y’^ycVu' ' 'yn when 
I «=3 lo, Si, ■ • -Xn, respectively. The values of the independent variable 
may or may not be equidistant. 

The Lagrange formula can also be written in the form 


n TT {^\ 

(27.2) y = 2 

where II„ {x) = (x — Xo)(x — Xi) 


i — • • n; 

(x — x„), 


II'„(x)^-^n„(x). 


Since Lagrange’s formula is merely a relation between two variables^ 
either of which may be taken as tha independent variable, it is evident 
that by considering y as the independent variable we can write a formula 
ginng X as a function of y. Hence on interchanging x and y in (27.1), 
we get 


(27.3) 


• '(y— y-) j. 

(yo~yi)(.yo — yi)- ■ -(yo— j/„) ® 

. (y— yo)(y— ys)- • -(y— yn) ^ 

(yi — yo)(yi — yj)- • -(yi — yn) ‘ 

4 - (y— yo)(y— yP- • -(y— y-) j . .... 

(y 2 — yo)(y 2 — yi) • • • (yt — y») * 

. (y — yo)(y — yp- • -(y — yn-O ^ 

(yn yo)(yn yi)’ ■ ’(yn yn-i) 


The chief uses of Lagrange’s formula are two: (1) to find any value of 
a function when the given values of the independent variable are not 
equidistant, and (2) to find the value of the independent variable corre- 
sponding to a given value of the function. This second problem is solved 
by means of formula (27.3). 


We shall now work two examples to illustrate these uses. 


K'^y'^xample 1. 
X and logic x. 


The following table gives certain corresponding values of 
Compute the value of log 323.5. 


I 

321.0 

322.8 1 

324.2 

[ 325.0 

logi.x 

2.50651 

2.50S93 

2.51081 

2.51188 


Solution. Hcrex— 323.5, Xc 321.0, x, = 322,8, Xj=. 324.2, x^^ 325.0. 

Substituting these values in (27.1), we get 
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log,, 323 5 


(323 5 — 322 8)(323 5—324 8)(323 5 — 325 0) 
(321 — 322 8)(3M— 324 2)(321 — 325) ^ 


(323 5 — 320(323 S— 324 g)(323 5— 325) 
(3228 — 321)(3228—3«42)(3228 — 325) 


(323 5 - 321)(323 5—322 8)(323 5 — 325) . 

(324 2 — 321)(3248— 3228)(3242 — 32*)^ 


(323 5 — 321 )(323 5 — 322 8)(323 5 — 324 21 
+ (325 — 321)(325 — 3228)(325 — 324 2) ^ 


— — 0 07996 4- 1 18794 + 1 83897 — 0 43708 


~ 2 50987 


This result is correct to the last 6gure 

The shore example has alreadj been worked in Art. 26 by formula 
(26 1) The student should compare the amount of work m the two cases 

EtampU 2 _ The following table gises the raluee of the probability 
integral corresponding to certain ralues of ». Tot what 

value of z IS this integral equal to 


(2/Vr)/;4-‘<t» 

X 

0 4846555 

0 40 

0 4937452 

0 47 

0 502749S 

0 48 

0 6116683 

0 49 


Solution Calling y the raloe of the probability integral, we hare 
y — J — 0 5, z, — 0 46. z, — 0 47, z, — 0 48, z, — 0 49 
Substituting these in (27 3), we get 

_ (05 — 0 4937452) IP g — OJOCTSM) tUJ — 0.5116683) 

® (0 48S6556 — 0 4937452 J (VS945S55 — 0 ^7498) (0 4S4S6S5 — 0 6116683) ® ” 

(05 — 0 <846555 ) (OJ — 0,5067488 ) { 0 5 — OAll 6683 ) 

+ (04937452 — 048Sfi555)(04037452 — 0A0274MM04837452 — 0All«883) 

(OJ — 0 4840555) (0 5 — 04M7452) (OA — 0^118683) 

(0 5027498 — 0 4848555 M0AO27 498 — 0 4037452) (0 S027498 — OAl IC681 1 X 0 

(05 — 0 484e555){OS — O4037452)(0A — 0J027488) 

TOAlleOSS — 04848555) (OAI188S3 — 04937452) (0A116633 — 0 S027498) X®*® 
62548x27493x110683 
~ 90897 X 180943 X 270188 X 0 <6 
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153445 X 27498 x 116683 
+ 90807 X 60040 x 179231 ^ 

153445 X 62548 X 110683 
180943 X 90046 x 89185 ^ 

153445 X 62548 X 27408 
“ 270128 X 179231 x 89185 
= — 0.0207787 + 0.157737 + 0.369928 — 0.0299495 
= 0.476937. 

The true value to six decimal places is 0.476936. 

Note. The computation in this problem should be performed by 
logarithms unless a calculating machine is available. 

Remarh. The reader who has followed through the computation in 
the two preceding examples will have noticed that Lagrange’s formula 
is tedious to apply and involves a great deal of computation. It must 
also be used with care and caution, for if the values of the independent 
variable are not taken close together the results are liable to be very 
inaccurate. 


EXERCISES 111 

1. Using formula (26.1), find from the following table the value of y 
for 5 — 5.60275. 

s I 5.600 I S.602 I 5.605 | 6.607 \ 6.608 

y I 0.77566688 1 0.77682686 1 0.77871250 j 0.77996571 j 0.78059114 

2. The following table gives some relations between steam pressure and 
temperature. Find the pressure at temperature 372°.l. 

T 1 361° I 367° I 378° | 387° | 399° 

p 1 164.9 I 167.0 1 191.0 \ 212.6 j 244.2 


8. Find from the following table the value of y for 5 — 0.632762. 

5 I 0.6305 I 0.6342 | 0.6357 j 0.6382 

' y I 0.673112024 j 0.677676761 j 0.679389428 ( 0.682413940 

1 0.64f5 1 0.6462 

1 0,686412828 } 0.692121131 
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4. From the data m the tollovmg table find by Lagrange’s formulas the 
value of y when x — 102 and the valoe of x when y — 13 5 


03 0 
06 2 
100 0 

104 2 

105 7 


It 35 
12 80 
14 70 
17 07 
10 01 



CHAPTER IV 


CENTRAL-DIFFERENCE INTERPOLATION FORMULAS 

28. Introduction. Newton’s formulas (I) and (II), derived and illus- 
trated in Chapter II, are best suited for interpolation near the beginning 
and end, respectively, of a table of differences. For interpolation near 
the middle of a difference table, central-difference formulas are preferable. 
These formulas employ differences lying as nearly as possible on a horizontal 
line through t/o in a diagonal difference table. 

The most important central difference formulas are the two known as 
Stirling’s and Bessel’s. We shall derive them by first deriving three other 
central-difference formulas and then taking the means of the latter in pairs. 

29. Gauss’s Central-Difference Formulas . 

Gauss’s forward formula. In the general Newton formula (26. 1), 
put Xo^ Xo, ii = 3-0 h, = — h, X 3 = ro-\-2h, Xt=Xo — 2Ji, 

x^ =!=: Xq -j~ 3//, Xc = Xo — 3li . 

Then we have 

(29.1) y=.yo4-(a' — ®o)8(a;o, So + A) 

+ (a; — So)(s — So — i^)S(so, So -f A, So — h) 

"t" (® ®o)(® ““ Xo-^}i)(x Xo -|- h)8(so, So Tif Xo~~1i} Xo 2h) 

+ (s — io)(s —Xo~h)(x—Xo-i- h){x— Xo — 2h)S (so, So -f h, 

So hfy So 2it, Xq 2^) 

-f (s — So) (s — Xo — k){x — So -f ft) (s — So — 2ft) (s — So -f 2ft) 
X 8(so, So *4- ft. So ft, Sq “4“ 2ft, a^o 2ft, So "4~ 3ft) 

Now put u«= — ^ — , or s — So=»ft«. Then 

(29.2) y =• yo + ft«8(so, So -f ft) -f ft w(ftu — ft)8(a;o t- ft, Xo, So -4- ft) 

-4- huQiu — ft)(ft« -f ft)S(so — ft. So, So -4- ft. So + 2ft) 
f ftu(ftti — ft)(ftu + ft)(7i« _ 2ft)S(so — 2ft, So — ft. So, 

So “4* ft. So -4” 2ft) 

-f ftu(ft« — ft)(ftu + ft)(ft«— 2ft)(ftu + 2ft)8(so— 2ft,So — ft. 

So, So -4~ ft. So -4- 2ft, a^ -4* 3ft) 
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Bat, by (25 1), 

S(x,, X# + A) — *(*# — K Xu, + A} — 

«Cr, — A, Xo, X, + A, la 4- 2A) — 

J(i« — 2A, X, — A, x», X, + A, X, + 2A) — 

!(Xa— 2A, x»^ A, Xa, Xt ^ AjXa^" 2A, Zf 4 3 A) * ' 

SubstitutiEg thee« into (29 2) and caacelmg tlie powers of A ra each 
term, we get 

(29. 3) -y — y* + «Ay, + «<«—!) + u(u* ^ I) 

+ «(a*-l)(ti-2)^+a(a*-l)C«x*-2')^. 

This 18 the Oaass forward formula 

batkwotd Gvi><a haiAwte-i fiwmilA, 

make the foUowug substitutions m the Newton forjonla (26 1 ) : 

Xa — Xg, X|~x«— A, Xt«-Xa4*A, Xfi—Xa — 2A, x*-"Xo + 2A, 
Xi^x,— 3A, x«-»X443A 
Then (26 1) becomes 

(29 4) y — y, + (x— x,)?(i„x,— A) + (x— Xe)(x^x# + A) 

X «(#•.*» — A, x, + A> 

+ (X — X«){X — X« + A){X — Zb — A) 

X 6(x*, x» — A, X, + A, X, — 2A) 

+ (x — xq)(x — x« + A)(x — x» — h){f — X# + 2A) 

X »(»o, X, — A, X, 4 A, X, — 2A, X, 4 2 A) 
4(*— x,)(x— X, 4A)(i— X, — A){x— x,42A)(x— X, — 2A) 
X 3(x«,x, — A,x,4A,x» — 2A,#842 A,i# — 3A) 

Now put « — or X — x,4A« Then 

(29 5) y“yB4Au3(x8 — A,x#)4Au(uA4A)S(x,^A,Xe,Xa4A) 

4 «A (uA 4 A)(iiA — A)3(x« — 2 A, Xo ^ A, Xo, x» 4 A) 
4uA(uA4 A)(oA — A}(«A42A) 

X 5(x« — 2A, x» — A, x«. Xo 4 A, Xo 4 2A) 

4 uA(uA 4 A)(bA — A)(uA 4 2i()(uA-— 2A) 

X 8(x»— 3A,x,— 2A,x,--A,X|„Xo 4 A,Xg 4 2A) 
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But 

Kxo — hiCo)=^, Kxo—h,Xo,Xo + h)’=-^ 

jk ^ 

8(®0 2fi., So So “{■ ^) “ gj^s 

*> 

^(fTo ■“ iTo 2?o, Xq ”1“ ^0 “f” 2^) == 

5(x() ——3^^ Xq ““ X(j Jiy Xoj X0 — I” hf x© Shf) *==» g I ^5 

Substituting these into (29. 5) and canceling the powers of A in the several 
terms, we get 

(29. 6) y “ yo + «^y-i + + 1) +u{u^—i) 

+ uiu^ _ 1)(„ + 2)^ + «(«* - 1)(«* - 2^) , 

which is the Gauss backward formula. 

(c). A third Oauss formula. For the derivation of Bessel’s formula 
we need a third central-difference formula that starts with yi and runs 
parallel to the backward formula (29.6). To derive such a formula we 
advance the subscripts of s and y in (29.4) by one unit, remember that 
s, — So, and change the u’s by putting = 1 in the general formula 



and thus get the relation 

u — !■= V -- , or s — Xi = hu — h 

fl 

These changes amount to advancing all subscripts in (29.6) by one unit 
and replacing u by u — 1. These changes then reduce (29.6) to 

(29.7) y*=yx + (« — l)Ayo + «(«— l)^-f«(« — 1)(« — 2)^ . 

-f u(«* — 1) (« — 2) ^ -f u(tt* _ 1) („ _ 2)(« — 3) ^ , 
which is the desired formula. 

The following table shows the paths of the three Gauss formulas across 
a diagonal difference table. The designations G„ Gj, Gt refer to formulas 
(29.3), (29.6), and (29.7), respectively. 
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AV ^*9 ^*9 



/ 30 Stirling’s laterpoUtloQ Fomuila. Taking the mean of formulas 
'^(29 3} and (29 0), bj adding them and dividing the sums throughout 
by 2, we get 

s-s,+„(^Ss±^ + (^v.+^v- o. 

. u*(u*-l) .... , «(«»— l)(ti»-2’) A»y^ + A»y-, 

•r 45 “y*T 6' 2 ’ 

which 18 Stirling’s formula Nota that it goes horizontally through In 
its more general form Stirling’s formula is* 




Ant. SO] 


STIRLING’S FORMULA 


83 


. Lv.i + Ai/o I « I — 1") 

(III) yc=.yo + « 3I 2 


4! 


A‘y.2 + 


3! 

— !=)(«= — 2-) A ^3 4- AYa 


5! 


«*(«= — !=)(«= — 2^) 
6 ! 


A Va + ■ 


^(^2 _ ii)(ug — 2=)(u^ — 3-) • • • — (ft — 1)-] 


(2n — 1)1. 


X 


A^'-^y-n + A^»-^y.,n-n 
2 


, «=(„*_ !=)(«= _20(«^_ 3*)- ..[„=_(« _1)^] 

+ (2^0! 

where «=(i — x^)/h. 

In this formula there are 2n + 1 terms, and the polynomial coincides 
with the given function at the 2n + 1 points 

« = — fi, — (n — 1), — (n — 2), 2, — 1, 0, 1, 2, • • • ft — 2, ft — 1, 71; 

or 

» = a;o — n/i,Xo — (ft — l)^j‘ ’ ‘^o — A, a;©, Xo + h, • • ‘Xo + (n — l)?i,Xo-fnh 


The path of Stirling’s formula across a diagonal difference table is 
shown in the table below. The quantities that occur in the formula are 
printed in heavy typ-c. 


y 

Ay 

A*y 

A»y 

A*y 

A’y 

A'y 

A’y 

A'y 

y-* 










Ay-< 








y.t 


A’y., 








Ay., 


A'y^ 






y.t 


A»y.. 


A'y., 






Ay., 


A’y-, 


A’y., 




y.i 


A*y-, 


A'y., 


A'y., 




^Ay-x 


Ay., 




Ay., 


y<i < 


Ay., 

"X A’y., 

■ 

^y.. 

A'y., 

Ay., 

A'y., 

Vx 


A’y, 


A'y., 


A'y., 


A'y., 


Ay, 


A’y, 


A'y., 


A’y., 


y. 


A*y, 


A'y. 


A'y-, 




Ay, 


A’y. 


A'y. 




y. 


A*y, 


A'y, 






Ay, 


A’y, 






y, 


A'y, 








Ay, 








Vt 










Table 7. 
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81. Bessel’s Interpolatloa Formolss. On takuig the mean of (29 3) 
and (29.7), hj addmg them and dindmg by 2, ire obtain 

■ t i(u — i)(u— 1) ■ u(u*— 2) (^«y., 4- Ay. ) 

-t- j, j 

. «(u— 4)(«* — 1)(«— 2) 

+ — i!-. 

Thu u one form of Bessel's formula It follovs a horizontal line mid 
way between and in the difference table 
The above formula u frequently written in a eligbUy different form 
Smce Aya — y, — y*, the fint two tenns tan be itansformed to 
Then (31 1) becomes 

(31.2) .1 ) 

. tifa«-l)(u~2) A«y^+A*yo . 

4» 2 

The general form of Bessel’s fomnla it 

(IV) + i(^=mL=}l V, . 

1 «(ti*--l)(u— 2) A*y.^ + A«y., u(u— iXtt*— l)(tt— 2) . 

"^41 3 61 

, «(«* — l)(u*— 4)(u— 3) A*y-, + A*y-, , 

■*■61 2 + 

, u(u* — l)(u* — 4) (o_n)(u-f n — 1) A**Vhi + 

(2n)I 2 

, «(u—^)(u*— !)(«*— 4) (u— n)(u4-n— 1) 


If we put in (IV), we get the simple formula 


Art. 31] 


BESSEL’S FORMULAS 


85 


Vn + Vi , A*y_i + A*t/o , 3 A^y-a + AV^ 5 A^y-s + AVs 

(V) y— — 3 t 3 T J38 3 1024 2 

ri-3>5- • -(2*1— 1)3^ A^»y-„ + A^'--y-<ui . 

+ ••• + (--1) 2*"(2n)! 2 


This important special case of Bessel’s formula is called the formula for 
interpolating to halves. It is used for computing values of the function 
midway between aiiy two given values. 

A more symmetrical and convenient form of Bessel’s formula is obtained 
by putting u — | = v, or « = v + Making this substitution in (IV), 
we get 


(VI) y=^^^^4-«Ayo + 



A^y-i 4- A=yo 
2 


• 3! 


A*y.i 


+ 


(t>— i)(i^=-|) 
4! 


A*y-2 4- A^y-i , t>(v- — — I) 8 

2 5! 


+ 


6 ! 


AVa+AVa 
o » 


_ ^) (t,» _ I) . . . _ ( 2 n _ 1 ) 2 / 4 ] A»"y., + A»»y^,a 

(2n) I 2 


+ 


v(v* — i)(v* — I) • • •[v®—(2n — 1)741 
(2n + l)l 


A*"^*y.n . 


In formulas (IV) and (VI) there are 2ft + 2 terms, and the polynomials 
represented by them coincide with the given function at the 2n -}- 2 points 


u„_n, — ft + 1, — ti + 2,- • • —1, 0, 1, 2,- • •ft,ft + l; 

2ft-}-l 2ft— 1 ^ J 1 3 2n— 1 2ft + l 

“ 2 ’ 2 ’■■■ 2’ 2’2’2’ 2 ’ 

!•=. lo— nh,®o— (ft— l)h,- • • Xo — h,*o, aro + h, • • -So + nh,Xo +(ft + l)h. 

The zero point for the t;’B is Xo + h,/2, whereas for the u’s it is Xo- ’ 


The following table shows the path of Bessel’s formula across a diagonal 
difference table. The quantities that occur in the formula are printed in 
heavy type. 



INTERPOLATION— CE^TIUL•DI^FEBE^CE FORMULAS ICbap IV 



^y-4 







V-* 

Ay X 

A’y. 

A‘y^ 





y • 

Ay, 

A’y , 

A'y • 

AV-. 

A'v . 



Vi 

Ay I 

A'y^ 

A'y. 

AV. 

AV. 

AV-. 

AVh 

y« 


A‘r. 


AV. 


AV. 

A'y^ 


Ay. 


AV. 


AV. 


AV- 

yi 


A'y. 


AV. 


AV. 

AV- 


Ay> 


AV. 


AV, 


AV. 

Vt 

Ay, 

A'y. 

A'y. 

AV. 

A'y. 

AV, 


v< 

Ay, 

AV. 

A'y, 

AV. 




Vi 

Ay. 

A‘V. 






v< 









fth&U now &ppl; SlitUng’* wA Besael’k {otmulu to eont sumeneol 

ExampU 1 Th« following Ubie gives the values of the probabilitj 
integral * 


for certain equidistant values of x Find the value of this integral when 
1 — 0 5437 


- 

A*) 

; 4fW 

AA*) i 

A«A*) 

A'/{») 

0 SI 

! 0 6292437 







1 S65S0 




0 52 

0 5378987 •' 


-696 





^ 85654 


-7 


0 S3 

0 6464641 i 


-903 


0 







- 0 64 

0 S5493927‘- 


-910 


0 

— — 


83841 


-7 


0 S5 

0 5633233 


-917 1 


1 



82924 


-6 


0 5« , 

0 5716157 


-923 



1 


82001 




0 67 

0 5798158 
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Solution. Here we take Xo — 0.54 and x == 0.5437. Since h = 0.01, we 

have ’ -• 

x—Xq _ 0.5437 — 0.54 _ 0.0037 _ ^ 


(a) Using Stirling’s formula, (HI), we have ^ ^ A 

(84751 4- 83841) 

/(0.5437) = 0.5549392 + 0.37 j V 

. / oin^ J. 0-3nQ-3y^-l) (-y-7) 

+ ■ 2 2 6 

= 0.5549392 + 0.00311895 — 0.00000G23 + 0,00.000004. 
0.6580520. 

et=s '' ■ " ■■ ■ ' ■ 

(b) To find /(0.5437) by Bessel’s formula it is more convenient to use 
(VI). Here 

V == ,i _ ^ = 0.37 — 0.50 = — 0.13., 

Substituting in ( VT) , we have 

/(0.5437) ^ P-5549392 + 0.563^3 (—0.13) (83841) 


0.0169 — 


0.25/— 910 — 917\ , —0.13(0.0169 — 0.25) (—7) 

V 2 - 6 


== 0.55913125 — 0.00108993 + 0.00001065 
= 0.5580520. 

Example 2. The values of e*^ for certain equidistant values of a: are 
given in the following table. Find the value of e:^ when 1 = 1.7489. 



0.1790661479 


0.1772844100 

0.1755204006 

(U737739435 

/ I 

0.172044S638 

0.1703329SS8 


-17817379 


-17640094 


-17464571 


-17290797 


-17118750 


177285 


175523 
173774 ■ 
172047 
170335 



1.78 


0.16S63SI473 


-16948415 
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i^olulton. 

(a) By Stirling’s formula 

Here we take * — 1 7489, — J 75, A — 0 01 

Hence 

1 7489 — 175 00011 

“ ool Tol 


Substituting iQ (III), we hare 
/(1 7489) — 0 1737783435 —0 11 


(—17464571—17200797) 


+ 0^ (1,3,74) -0 1. ( -»«- ■ »« ) 

+ 0 0181 ( °°‘y,~* )(»a) 


— 0 1 737739435 -f 0000J9J16452 
•f 0 00000010513 — 000000000315 , 
or /(I 7489) - r« - OlMOgWOOO 
This ralue is correct to fan decimal places 


(b) By Bessel’s formula 

Since the ralne 1 7489 is nearer to the middle of the interral 1 74 — 1 75 
than it is to the middle of the interval 1 75 — 1 76, we take » 1 74 so 
as to make v as small as possible Hence we have 


/(I 7489) 


1 7489 — 1 74 


— 0 89, 


0 01 

v — u- J— 0 89 — 0 50— 0 39 
0 1755204006 + 0 173773043 


4-0 39(— 17464571) 


/ 039^ — 025 \ / 175533 + 173774 \ 




-A 


^ (039* — l)»5)(03y — ggsYla + gg) 
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-= 0.17464717205 — 0.00068111827 
— 0.00000085490 + 0.00000000111 
+ 0.00000000001 ; 

or /(1.7489) == 0.1739652000, as before. 

We could also take Xo = which ca.«e we should have v *= — 0.61. 

This would give 

/(1.7489) == 0.17290940365 + 0.00105473862 

+ 0.00000105562 + 0.00000000214 
— 0.00000000002 = 0.1739652000. 

This value is also correct to ten decimal places, but the series converges 
slightly less rapidly than in the preceding case; and both of these series 
given by Bessel’s formula converge a little less rapidly than the one given 
by Stirling’s formula. 

Remark. The question naturally arises at this point as to which is the 
more accurate, Stirling’s formula or Bessel’s. The answer is that one is 
about as accurate as the other. For a given table of differences the rapidity 
of convergence depends upon the magnitude of u in the case of formula 
(III) and upon' the magnitude of v in the case of formula (VI). The 
smaller the values of u and v the more rapidly the series converge. We 
shoiild therefore always choose the starting point Xq so as to make u and v 
as small as possible. In most cases it is possible to choose the starting point 
so as to make — 0.5 ^ ^ 0.5 and — 0.5 ^ v ^ 0.5. Thus, in Example 1 
the starting point was so chosen that u = 0.37, v = — 0.13 ; and in 
Example 2 w'e had u = — 0.11, 0 = 0.39. It is to be noted that Bessel’s 
formula converged the more rapidly in the first example and Stirling’s 
the more rapidly in the second, the reason being that v was smaller than 
u in the first case and u smaller than v in the second. 

ils a general rule it may be stated that Bessel’s formula will give a more 
accurate result when interpolating near the middle of an interval, say 
from u = 0.25 to 0.75 (v = — 0.25 to 0.25); whereas Stirling’s formula 
will give the better result when interpolating near the beginning or end 
of an interval, from u = — 0.25 to 0.25, say. 


For another phase of this question see Chapter VI. 




i?o2u<ton SiDce ve are to fis4 the ralae of the foocUoB halfra; betveen 
tvo giren tabular raluea, we uae fonntUa (V) for isterpolating to balres. 
Hence ve hare 


P(23*S) 


0 406834931 + 0 425026420 
2 


1 61709 + 64420 
8 2 


4-^7 

2 


— 0 4169306755 — 0 0000078831 — 0 415922792 


This result u probably correct to its last figure, emce the differences in the 
table are petlectlj regular and decrease rapidly 


EXBBCISSS IV 

1. Find logiotan66'43''5 by Bessel’s formula (IV) or (VI). giren 

log tan 62' -= 8 1797626 — 10 
“ " 63 » 81880364~10 
" “ 64 —81961555 — 10 
“ " 55 —8 2041259 — 10 
“ “ 66 —8 2119526 — 10 
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« « 57 =8.2196408 — 10 
« “ 58 =8.2271953 — 10 
“ “ 59 =8.2346208 — 10. 


2. Find cos 0.806595 by Stirling’s formula, given 


cos 0.8050 = 0.693111235 
“ 0.8055 = 0.692750733 
“ 0.8060 = 0.692390058 
“ 0.8065 = 0.692029210 
“ 0.8070 = 0.6916C8188 
“ 0.8075 = 0.691306994 
“ 0.8080 = 0.690945627. 



3. Compute the value of 
following table ; 


(2/V’r) when a: 


0.6538, given the 


X 

{2/‘->lr)fSe-*^dx 

0.62 

0.6194114 

0.63 

0.6270463 

0.64 

0.6345857 

0.65 

0.6420292 

0.66 

0.6493765 

0.67 

0.6566275 

0.68 

0.6637820 


4. The mean atmospheric refraction, R, for a star at various altitudes 
above the horizon is given in the table below. Using Bessel’s formula 
for interpolation to halves, find the refraction for a star at an altitude 
of 27° above the horizon. 


h 

R 

22° 

2' 23' .3 

24 

2 10 .2 

26 I 

i 58 .9 

28 

1 49 .2 

30 

1 40 .6 

32 

1 33 .0 
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5. The declination of the moon at the beginning (noon) of certain days 


in August, 1918, was as 
F. M , August 25. 

given 

below.^ 

Compute the declination for 9 :35 

Aug 

20, 

— 16* 

O' 

61" 

.0 


21 

— n 

24 

51 

.8 


22 

— 6 

3 

29 

.4 

« 

23 

— 0 

17 

25 

.8 

« 

24 

+ 6 

30 

21 

.6 

«• 

25 

10 

66 

40 

.3 


26 

16 

39 

57 

.8 

« 

27 

19 

22 

3 

.7 


28 

21 

49 

48 

.3 

« 

29 

22 

56 

22 

.6 


30 

22 

41 

54 

.1 


6. The values of an elliptic integral for certain values of the amplitude 
^ are given in the table below Compute the value of the integral when 
« — 24* 36' 42" 


* 

n*) 

21* 

0 370634373 

22 

0 333705151 

23 

0 406834931 

24 

0 425026420 

2S 

0 443282329 

2S 

0 461605362 

27 

0 479993225 
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INVERSE INTERPOLATION 


32. Definition, Inverse interpolation is the process of finding the value 
of the argument corresponding to a given value of the function ■when the 
latter is intermediate between two tabulated values. The problem of 
inverse interpolation can be solved by several methods, hut in this book 
■ffe shall explain only three. 

33. By Lagrange’s Formula. One method of dealing with the problem 
is to use Lagrange’s interpolation formula in the form (27.3), in which 
X is expressed as a function of y. Example 2 of Article 27 was really a 
problem in inverse interpolation. We shall therefore not explain this 
method further. 


34. By Successive Approximations. A second method is that of succes- 
sive approximations or iteration. To see how this method is applied let 
us consider Newton’s formula (I), namely, 


u{u — 1) , u{u — l)(u — 2) 

y *= yo + «Ayo + A^yo H A*yo 




Transposing and dividing through by Ayo> "we have 

(1) y — yo — l)A^yo u(u — l)(u — 2)A^yn 

“ Ayo 2Ai/a 3 1 A 1/0 

u(u — 1) — 3) A^yo 

4! .Ayo ■ 

To get a first approximation for «, we neglect all differences higher 
than the first and therefore have 


Ayo 

The second approximation is obtained by substituting" in the right- 
hand side of (1). We then have 
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y— y* A*y. u(«)fu»>^l)(u««» — 2) A«y, 

“ "" Ayo 2 Ay# ” 3 f Ay# 

4 1 Ay, ' 


The third approximation u 
(3) u _____ ^ 

u(*l(ttW_l)(u<ti-_2)(«<«> — 3) A«y. 

41 Ay. • 


And eo on for high«r approxunationa 
We ahall nov lUnatrate the method by worlang an example 


'EximpU I Oiren a table of valnea of the probabibty integral 
8/V*) for what Talne of s u this integral equal to 


X ! 

V 

Ay 

AV 

AV 

A*V 

0 4S 

0 4754818 

M737 




0 46 

0 4846SSS 

90897 

-840 

-11 


0 47 

0 4937452 

90016 

-851 

-ID 

1 

0 48 

0 5027498 

89185 

—861 

- 8 

2 

0 49 

1 

0 5116683 

88316 

-869 



0 so 

0 5204999 I 






Soluiton Here it is better to use a central'difference formula 
Inspection shows that the desired ralue of x lies between 0 47 and 0 48, 
and a rough linear interpolation shows that it is about 0 4?§ Hence 
we take i# — . 0 47 end use Bessel’s formula We therefore hare 
X# — 047, &— 001, y — J— 06 

Substituting in Bessel’s formula (^'l) this ralue of y and the appropriate 
quantities from the table, we hare 
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0.5 0.4982475 + 0.0090046t; + 0.0000856) 

0.0000010). 

Transposing and dividing through by 0.0090046, we get 

(4) V = 0.194623 — (v*— 0.25)(— 0.004753)— t)(n* — 0.25)(— 0.0000185). 

A first approximation for v is obtained by neglecting all terms beyond 
the first in the right-hand member of (4). Hence 

v(0 = 0.194623. 

Substituting this for v in the right-hand member of (4), we find tne 
second approximation to be 

=0.194623 — [(0.194623)“ — 0.25] (—0.004753) 

— 0.194623[(0.194623)“ — 0.26] (— 0.0000185) 

= 0.194623 — 0.001008 — 0.000001 = 0.193614. 

Now substituting this value for v in the right-hand member of (4), we 
find 

v(8) =,0.194623 — 0.0010101 — 0.000001 =0.193612, 

This value differs only slightly from the preceding, and we therefore 
make no further approximations. 

Since « = v ^ and a: = a;o -f hu, we have 
u = 0.693612, 

X =, 0.47 -f- 0.01 (0.693612) = 0.47693612. - 

This value is correct to six decimal places. 

Note. In this example it is not possible to obtain more than five 
trustworthy figures in the value of v, because the right-hand member of 
(4) is the result of a division by the approximate number 0.0090046, 
the fifth significant figure of which is uncertain. As a matter of fact, 
ouly the first four figures in v are correct. 

If all diSerences higher than the second are negligible, the problem of 
inverse interpolation amounts only to the solution of a quadratic equation. 
The following example illustrates this. 
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Example £ Given sinhi — 62, to find * 

£oIuhon Forming a difference table aa shown below, we find that all 
differences above the second are lero We also notice that the leqoired 
raise of z is slightly greater than 4 82 Hence we take Zg — 4 82 and 
use Stirling’s formula 


Z 

t-enhi 


AV 


4 80 

60 7611 

6106 



4 81 

61 3617 

6168 

63 


4 83 

61 0785 

6330 

62 


4 83 

63 COIS 

6393 

63 


4 84 

63 3307 





Substituting yi-62 m Stirhog's formula (III), ws have 
62 — 61 2785 + 0 61S9u + 0 OOSJu*, 
or 31u> 4.6192V — 215 

— 6199 4- V(fil22)» 4- 4 X 31 X 215 —6199 4- 6801 1_5 

62 “62 


215 

“ 62 ■ 


Since A — 0 01 and z — 4* Av, we get 

1 — 4 82 4- 0 01(0 0347) — 4 8203 


35 By Reversion of Series The most obvious method of solving the 
problem of inverse interpolation is by reversion of senes, for all the inter 
poIatioQ formulas thus far developed are in the form of a power senes, 
and any convergent power senes can be reverted. Thus, the power senes 
(1) y— fl«-f-o,z4.o,z*4-a,z*4- <i,z"4- 

when reverted becomes 






( 2 ) 
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where 



When reverting a series with numerical coefficients, it is better to com- 
pute the c’s from equations (3) and then substitute their values in (2), 
We shall now write Newton’s, Stirling’s, and Bessel’s formulas in the 
form of power series and then write down the values of Oo, Oi, • • • a^ 
in each case. We stop with fourth differences, but the reader will have 
no difficulty in extending them to higher differences if necessary, 
o) Newton’s Formula (I). 

!>-y. + A-s. 

, «(« — 1)(« — 2)(u— 3) _ 

+ 4! ^ ^'0 

Here 



A’yo A^yo 

3 4 ’ 


llA^yo 

2 2 ’ 

24 ’ 

^ G 4 ’ 

24 
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b) SUrhng'a Formula 




-f AV-t 




— i (Ay.i + Ay.) — (A*y-t + A*y.«) 


a,-iA*y.i—5j A*y^ 




-2l ^V. 


c) Bessel’a Formula (VI) 

, A«y., + A«y-. 

-r g ay-.-r 2 

— Ky. + yi) — + 4*y«) + 

+ (^yi>— ^AV-0»4-[i(**y-i + ^*y )— ^ (AVt+A'y-t)]"* 
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Here vre have 

flo = ifoo + !/0 - + ^*y-0 

ai = Ayo — ^ ^'y-i 

o, = + A=j/o) — ^ (A^y.j + A«y_0 

as = iA=y_i 

^ (^*y-2 + A^y-i)- 

We shall now work Examples 1 and 2 of the preceding article by 
revetting the series. Eor Example 1 we nse Bessel’s formula as before. 
Prom the table on page 94 we get 


i(yo + yi) = 0.4982475, i(A-y_j + A=t/o) = — 0.0000856, 
i ( AV-- + A^y-t) = 0.00000015. 


Hence 


flo = 0.4982475 + = 0.4982582, 


fix 0.0090046 + _ 9.00900464, 


a- =■ 


0.0000856 


24 


0.0000428, 


0.0000010 


■0.00000017, 


Since y = f - 


04 <=0, practically. 
^ 0.5, we have 


Also 



0.5 — 0.4982582 
0.00900464 


0.1934336. 



0.0000428 

0.00900464 


0.004753. 


(— 0.004753)= = 0.0000225910, 


0.0000001074, 


£s 


0.00000017 

0.00900464 


0.00001888. 
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Hence 

c , — — 22.^0 004153 , 

0 , 

c, — 0 00001888 -f- 8(0 000022591) — 0 00006406, 

f, ^ 0 4- 5(— 0 004153) (— 0 00001888) — 5 (— 0 0000001074) 

— 0 000000986. 

Substitntmg these qauitities in (2), ve get 

V — 0 1934336 + 0 004753(0 1034336)* -f 0 00006406(0 1934336)* 

» 0 1934336 + 0 0001178 + 0 00000046 
— 0193618 
Hence 

u — 0 + 1 — 0 693612 

and 

* — *, + fcu — 0 47 + 0 01 (0 693612) — 0 47693612, 
which IS the same ralue as fcnod by the method of successira approsimatioss 


To solee Example 2 we use Stirling's tormula, as before Here 
9, — 61 9785, 

Oi — 0 6199, 

a,-im^OO0Sl, 

<H — o, — 0 

Since y — 62, we bare 

y — A, ^62 — 61 9185 — 0 0225 


Hence 


• y 00215 

■ a* 06199’ 
g, _ 0 0031 
o, 0 6199 


-0 034683, 
— 0 005001 


c,— — 0005001, c, — 8(0005001)* 
e, — 0, practically. 


Substituting these values m (2), we hare 


0 00005002, 


u . 0 034683 ^ 0 OOSOOl (0 034683) * 
— 0 0347. 


a; — 4 82 + 0 01(00347) — 4 8203, 
as preriously found by the method of iteration 
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Remarh. The problem of inverse interpolation should he dealt -with in 
practice by the iteration process when only a few digits are to be substituted 
in the right-hand member, and by reversion of series when the number of 
digits involved is large. 


EXERCISES V 

If cosh 2 •= 1.286, find or by inverse interpolation, using the data in the 
following table : 


z 

cosh X 

0.735 

1.2824937 

0.736 

1.2832974 

0.737 

1.2841023 

0.738 

1.2849085 

0.739 

1.2857159 

0.740 

1.2865247 

0.741 

1.2873348 

0.742 

1.2881461 



CHAPTEB VI 


THE ACCURACY OF IHTERPOLATION FORMULAS 

30. latroductioa. In tlie prece^; articles ve have dealt vith pol;* 
nomial formulas for representing a giren function over an mterraL ^ese 
polynomials coincide vith the given fonction at the points ( 21 ,^ 1 ), 

etc. Hence it is reasonable to suppose that ve can make these 
polynomials approximate the given fonction as closely as desired by merely 
increasing the number of coinciding points Sudi indeed is the case if we 
don't attempt to spread over too wide an interval, but the necessity for 
caution in ^is matter will appear from the following considerations. 
When the number of points x*, Z|,fi, x* increases indefinitely, the 
polynomial interpolation formulaa become infinite senes, called tnierpoZo- 
lum amea, and just as a power series converges in a certain interval and 
diverges outside the interval, so likewise an interpolation senes converges 
and represents the given function ever a certain interval but fails to repre' 
sent it outside of that interval For example, if we sbonld attempt to 
represent the faoetton 1/(1 4- x*) over the interval -..SgxgS by an 
interpolation senes, we should find that the senes would not represent the 
function at all when x •»- 4 As a matter of fact, the senes would con< 
verge and represent the function to any desired degree of accuracy between 
— 3 63 and x>»4'3 63, but would diverge and fail to represent it 
outside of this interval * The investigatioo of the convergence of inter* 
polation series is a somewhat lengthy matter and requires the use of func- 
tions of a complex vanable f We shall tberefoTe not enter into it, but «ih*ll 
merely derive expressions for the remainder terms in the polynomial formu- 
las previously considered. 

37. Remainder Term in Rewton's Formula (I) and in Lagrange's 
Formulfl. The derivation of the remainder term in a polynomial inter 
polation formula la very similar to that of finding the remainder in Taylor’s 

“tlber cmpiriKhe FunktKmea ond dis laUrpoUtion twlKhen l^ul 
dutanten OrdlnsUn ' 2rilteSn/< fUr VatS und Pav*^. vol XLVI (1901), p 229 
See «1 m SteStnata’t Merpolatian, pp 95 98 
t The laterested reader should coaenlt the paper bj Ruege. cited abore, and also 
the following Eorel Uonographi NSrlnnd, tar Itt Settee d’lnterpolatton, 

Paris, 1926 Borel Z«fone ear lee Poaeliotu de yettaSIee JUeUa tt U* DettUfpe 
menie ea Blne$ it Poltpuyntt, Paru 1905 Montcl, Ltfont ear lee SSnee it Poly 
Mwee d v»e yonoM# Coetpleve, Pans, ISJO. dleo Kizsga e Thten* u»d Pru^ie der 
BtOM, Leiptig. 1904 
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Akt. 37j REMAINDER IN NEWTON'S FORMULA (I) 

expansion. Thus, to find the remainder term in Newton’s formula (I) 
and in Lagrange’s formula, we write down the arbitrary function. 


(1) F(s) = /(s)-<#.(s)-[/(®)-<^(x)] 


(z Jq) Xi) • • * (g Xn) 

(a: — a;o)(x — — Xn) ’ 


where f{x) denotes the given function, ^{x) a polynomial interpolation 
formula, and z a real variable. We shall assume that f{x) is continuous 
and possesses continuous derivatives of all orders within the interval from 
Xq to Xfi, 

Now F(z) vanishes for the n-j- 2 values z ='x, Xo, Sj, • • • Xn", and since 
f(x) is continuous and has continuous derivatives of all orders, the same 
is true of /(z) and hence of F(z). F{s) therefore satisfies the conditions 
of Kolle’s theorem. Hence the first derivative of F{z) vanishes at least 
once between every two consecutive zero values of F(z). Therefore in 
the interval from Xo to Xn, F'{z) must vanish n + 1 times; F"{z), n times; 
F"'{z), n — 1 times; etc. Hence the (n + l)th derivative of F(z) will 
vanish at least once at some point whose abscissa is f. 

Since <}){z) is a polynomial of the nth degree, its (n+ l)th derivative 
is zero. Furthermore, since the expression (z — Xo)(s — Xi)(z — Xj) • • • 
(z — Xn) is a polynomial of degree » + l, it follows that its + 
derivative is the same as the (n + l)th derivative of z"’^, which is (n -}- 1) ! 
On digerentiating (1) times with respect to z we therefore have 


P(»*U (s) (s) —0 — [/(x) — tj,(x)] 


(n + 1)! 

(x — Xo) (x Xi) • • “ (X Xn) ' 


But since (z) 0 at some point z =i, we have 


0 

Hence 


(n + l)I 

(x Xo)(x — Xj) • • • (x Xn) 


/(x)— <^(x) 


(n + l)l 


(x — Xo) (x — X,) 


(x Xb) . 


Now since f(x) — 4>{x) is the difference between the given function and 
the polynomial at any point whose abscissa is x, it represents the error com- 
mitted by replacing the given function by the polynomial. Hence we have 

(2) Error •^En-=‘ (x— Xo) (x— Xi) • • • (x — Xn), 

where i is some value of x between Xo and x„. This is the remainder term 
in formula (2) of Art. 20 and in Lagrange’s formula (27.1). 

To get the remainder term in formula (I) of Art. 20 we recall that 
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* — Xo-^hu,! — Ti— k(tt — l),x — z,^h{u — %),'•• X — *» — fc(u — n). 

Substituting these Talues of * — *i, * — *», etc m (2) above, we have 

ei(»-l)(..-8) • <»-«). 

If the analytical form of the given function f{x) is unknown, then the 
best we can do u to replace (f) by lU value in terms of diSerences. 
From Article 18 we have 
(a) + 

Putting x^xa and Ax » A, we have from (a ) 

(S) + 


Kow since x g 6nh and { are values of x at points within the interval 
of interpolation (that is, between x* and f») we may, for practical purposes, 
pat f — Xg -f ifrtit. Ifakiag this tabsUiation ta (b), we get 


(C) 

Hence we have 

(d) 


/“>«) 


A- • 




4..1 * 


practically. Substituting this value of /*"•'> (f) in (3), we get 

( 4 ) 

The smaller the interval h ia taken the more nearly does (4) give the 
actual error 


38. Remainder Term In Newton’s. Formula (II). To find a formula 
for the remainder in Newton's formula for backward interpolation we write 
down the function 


P(t) _/(,)_*(,)-[/(x)-*(i)3 


(s — X.)(g— Xi.-t) (s— X») 

(*—*.)(*— (I — X.) ’ 


differentiate it n + 1 times with respect to a, tad put (e) — 0 for 
a •— f. We thus find 


or 

( 1 ) 


/(x)— ,^(l) . . , (X — Xg), 

Error — — — ■ -(i — 1 »). 



Abt. 38] remainder IN NE'WTON'S FORMULA (11) 

This is the remainder term for formula (2) of Art 21. 

To find the corresponding formula in terms of u we recall that 


'Xn 


X Xn-1 


:« + l, 






■Xo 


<u + n. 


Substituting these values for x — Xn etc. in (1) above, we get 

(2) + • {u + n). 

To find a formula for i?n when the analytical form of the given function 
is unknown, we replace by in (2). The result is 


39. Remainder Term in Stirling’s Formula. We next turn our atten- 
tion to the central-difference formulas of Stirling and Bessel. To find . 
the remainder term in Stirling’s formula we write down the arbitrary 
ftmction 


( 1 ) 


- [/w -4.W] 

UV ) 9\)S (x~Xo)ix — Xi)(x — X.i) 


■ (z~-X„)(z — X.r,) ^ 
■(x—x„)(x~x.„)' 


This function vanishes for the 2n 2 values 2 «=» ic, Xo, a:,, • ■ • s,, x.i, 
X-*, • • 'S-n. We assume that f{x) is continuous and has continuous 
derivatives of all orders up to 2n -f- 1. Hence F{z) satisfies the conditions 
of Rolle’s theorem. Also, since <fi(z) is a polynomial of degree 2n, its 
(2n -{- l)th derivative is zero. Hence on differentiating (1) 2n 1 times 
and putting (z) •=» 0 for some value 2 we get 


0 -0-[/(x)-,^(x)] 

from which 


(2n-t-l)! 

(x — Xo)(x — xi)(x — X.,) • • ■ (i — x„)(x 


— X., 


/(x)— p^j(i_x,)(i_3;,)(x— x.j)- • - (a:— x„)(x~x.n), 
or 


(2) Error ». /?„ _ .&^(a:_Xo)(x-xO(x-x.^) • • • (x—x,)(x~x.,) 

We write this formula in terms of u as follows: Since 
X Xo — Tiu, X — ii-=»h(u — 1),- • 'X — x„ — h(u — n), and 

X X., — (xo — h) — Xo-|-h*=7iu-|-h*=.h(tt-j-l), 

X x.s-»A(u-}-2),- • -x — x^ — 
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we have 

( 3 ) 

vbeie { IS some valoe of x beiweea x^ and r. 

If the analytical form of /(*) is unknown, we replace by 

where 

A****v , , 4* A**'**!-* * 

m,,„ — 

Hence we get from (3) 

In formulas (3) and (4) ft is the number of intervals on each ads of Xf 


40 Remainder Terms in Bessel's Formulas. The remainder term in 
, Bessel’s formulas is derived by first writing down the arbitrary function 


(1) f<*) “/<«)-♦(*) 




(s— g,)(s— g.l(t— a ,1 


(t— g.Kt— x..K«— »«.») 

(* — s»)(x •){i—x%.x) 


This functiou vanishes at the 2 n 4-3 points 
x. 4 i,z«,i Since ^(s) is a polynomial of degree Sn>f 1 > its (Sft + 8 )th 
derivative is zero Hence on differestiatiog ( 1 ) 2 n-f *2 times with 
respect to s and putting F*»»**>(s) — 0 for some value * — we get 


0 — — 0 

x.Xx— z.)(x^z!) (z--zO(z— z«i) ' 

from which 


/W— «l) - ' •> (» — *.)(! — I .)(I — I., 

or 

(2) Error — 


Putting x — Zo'^hu, X — X, — A(tt — 1), X — *i — k(«4-l), etc, 
as In the case o! Stirlings formula we get 

(3) ~ '‘(’^+"2')^ - 1)(« + 3)(» - 3) (U-»)(» + n)(«_„_l) 
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This is the remainder term in formula (IV) of Art. 31. In terms of 
differences it becomes 


( 4 ) Rn 

where 


( 2 ^+ 2 ) ! «(« - 1 ) (^ + 1 ) (« - 2 ) (^ + 2 ) 

• • -{u — n)(« + n)(tt — n — 1), 


On putting « = u + i in (3) and (4), we get 


(e) Rn 
(6) i?„ 


“(2n + 2) ! 


^2n*2 

(2n + 2) 




These are the remainder terms in formula (VI) of Art. 31. 

Putting v«=0 in (6) and (6), we get the remainder terms in the 
formula for interpolating to halves, namely 


(7) 

( 8 ) 


^^, [l-3-5 - • •(2n4-l)? 
(2n + 2)! ^ ^ 2-"*" 

p [1 • 3 • 5 • • • (2n -f- 1)]^ 

" (2n4-2)!'- ' 


41. Recapitulation of Formulas for the Remainder. We now collect 
for easy reference the most important of the formulas derived in this 
chapter. 

I. Newton’s Formula (I) 


( 6 ) 

(b) 


— 2) • • • (« — n). 


Rn 




j^)! »(u- 1)(«-2) - . . (u_R). 


S. Newton’s Formula (II) 

(a) 1 )! + 1) (« + 2) ‘ • ' (u-f n). 

^nut/n , , . . , 

"'=* l)(«4-2) • • (^n u). 


(b) P, 
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S Sl\rUng‘t Formula, (III) 

(b) («■-««) 

4 BetseVs Formula in terma of (IV) 

(0 (ix-f.)(u + «)(«-n-l) 


(b) R,. 


-ru(u—l)(tt + !)(«— 2) (ti— n)(u+n)(tt — n — 1) 


(2n+2)l 

C Bessel’t Formula in tenni of v, (VI) 

<•) 

G Formula for Interpolating to Baloee, (V) 

.. n (13 5 1)V 

<•> (2n + 2)J 


(b) 


7{-I)* 


. [1 3 5 (8n+l)T 


• (2n + 2)t' 

7 Lagrange'* Formula, (27 1) 

K. - (I - !.)(« - *.)(» - ».) 


(* — *.) 


Where the formulas are giren in pairs, the second form (b) should be 
used when the analjtie form of the function is not knovn 
To lessen the labor of computing ff. from these formulas the student 
should, when possible, use the expressions for the nth denratiTes giren 
on page 38 

It IS not worth while to compute the remainder term m man; appli 
cations of Newton's, Stirling's, and Bessel’s formulas, because if the 
ttarting point is so chosen that u and p are numcncall; less Ihnu 1 and 
if the differences of some order are practicall; constant, the interpolated 
result will usually be correct to as many figures as are giren in the 
tabular ralues of the function This statement is based on the assumption 
that all available differences are used in the interpolation formula, or at 
least all differences which will contribute anything to the last figure 
retained It is in those cases where the differences do not become constant 
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or 'where it is impracticable to make use of differences above a certain 
order that vre should compute the remainder term. 

When using Lagrange’s formula, ho'wever, the case is very different. 
Here there are no differences available and there is nothing in the formula 
itself by ■which we can estimate the reliability of the results obtained. We 
should therefore compute the remainder term in every application of this 
formula where it is possible to do so. 

It is to be observed, however, that the inherent error in Lagrange’s 
formula involves the (n + l)th derivative of the given function. When the 
analytical form of a function is not known, the inherent error due to the 
use of Lagrange’s formula cannot be estimated. 

The student should observe that the remainder term in Stirling’s formula 
contains odd differences, whereas in Bessel’s formula it contains even 
differences. If, therefore, when using a central difference formula we stop 
with even differences and wish to estimate the error, we should use 
Stirling’s formula ; whereas if we stop with odd differences, we should use 
Bessel’s formula. If this rule is followed, the remainder term will always 
be the next term after the one at which we stop. 

There should never be any difficulty in determining the proper value 
of n to be substituted in the remainder formulas. Thus, if we are using 
Bessel’s formula and stop with third differences, the remainder term will 
contain fourth differences. Hence we must have 2n -f- 8 = 4, or n = 1. 
On the other hand, if we are using Stirling’s formula and stop with 
fourth differences, the remainder term will contain fifth differences. Hence 
we shall then have 2n + 1 •== 5, from which n >= 2. 

We shall now compute the remainder term in an application of Bessel’s 
formula. 


Ezamyle. The following table contains values of the function 
y «- 1 * + lOx® for certain values of x. Find y when x = 2.27. 













no 
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Solution Since we wish to nee Bessel’s formula and compute the 
remainder term, we stop with third differences Taking Hg — 2 2 , 2 •— 2 87, 
A •- 0 1, wo hare 


— « — J — 02 

,-52?™Lpii!“+on>32 8296) 

^ ^ 004 — 025^ ^ 21 S9»D-f24 S920 ^ 
+ 02 (3 0930) 


— 80S 2036 + 26 56S02 ~2 46178 — 0 02165, 

ir 

y — 629 28609 

To find ^ 1 , we hare 2n + 2 — 4, otn — 3 Also 
/”{#)— 84 +1800* 

Seoce 

/<»(j)-.24+1200{ 


Kow since { lies somewhere between 2 0 and 2 5, we can express it in 
the form 

{—2 25 + 01,, 

where , lies between — 2 5 and +25 Substituting this value of ( in 
/'»({) above, we get 

— f»(2 25 + 0 1,) — 24 + 2T00 + 120, 

— 2724 + 120, 

Hence by (6) of Art 40 we have 

_ (0 l)-(a7|4 4 - 1?0,) ;o 0 ,,, 

— 0 00587 + 0 000232, 

— 0 00527 ± 0 00058 
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y 629.28609 + 0.00527 ±. 0.00058 
»= 629.29136 ± 0.00058. 


The value of y is thus between 629.2919 and 629.2908, or between 
629.292 and 629.291. The correct value to four decimal places is 629.2914, 
and this happens to be the mean of the two limits found above. 

If we substitute differences instead of the derivative in Rn, we have 
= (0.2664 + 0.2784) /2-= 0.2724; and therefore by (6) of 


Art. 40 




(0.04 — 0.25) (0.04 — 2.25) 


■== 0.00527, 

which is the definite part of the remainder term found by using the 
derivative. We then have y => 629.28609 + 0.00527 = 629.29136, which 
is correct to four decimal places. 

Note. The substitution i=>a;« + Aij, where Xm denotes the midpoint 
of the range of given values of the function, gives the remainder as the 
sum of two terms, the larger of which is perfectly definite and unaffected 
by the uncertain factor 17. It also saves the trouble of finding the greatest 
and least values of (''’{x) in order to find the limits between which the 
true value of the computed fimction lies. For Newton’s formulas (I) 
and (II) we make the substitutions I^So + Tiij and — hri, 

respectively, where 17 is now positive in each case. For computing 
in Lagrange’s formula we should put i =» x,™ + hi?, as in the example 
worked above. 

A final remark concerning accuracy must now be made. When the 
analytical form of a function is totally unknown, and the sum total of 
our knowledge of the function consists merely of a set of tabular values 
of the argument, the problem of interpolation is really indeterminate; 
for it is theoretically possible to construct a large number of functions 
which would take the values yo, yi, y-, - * • y« corresponding to the values 

iij Xjj • ■ • Xn of the argument. Nevertheless, if we have some knowledge 
of the nature of the function with which we are dealing and have no 
reason to believe that it behaves in an erratic manner within the range of 
values considered, we may fairly assume that its graph is a smooth curve, 
in which case the function can safely be replaced by a polynomial. 
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42 The Accuracy of Linear Interpolation from Tables We noT 
derive a simple formula for the maximum error inherent in linear inter 
polation from tables 

In the remainder after n -f- 1 terms in Newton’s formula (I) let us 
pot n — 1 Then Rn becomes 

(1) 

where 2f denotes the maximum abaoluta value of f'Cs) in any mUml 
of width A To find the maximum numerical value of we differentiate 
it with respect to u, put the derivative equal to zero, solve for v, and then 
substitute this vslue oi u in (1) Hence we have 




\R^\- 


J and 

ll Mii 


The formula for the raazimum error is therefore 

m 


Example The function 1/N is tabulated m Barlow’s Tables at unit 
intervals from 1 to 12,200 Find the possible error in the linear inter 
polation ol this function when 


Solution. 


y — 650 

/OT-i 

r{S)-§i 


Takit^ A — 1, y — 650, and substitutiug lu (2), we find 

£■< ? ^ 

— 4 X (650)* 1,098,500,000 ’ 

or 

£< 0000000001 


Note The student should ever bear in mind that linear interpolation 
IS permissible only when first differences are constant, or practi^iy so 
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He should therefore always compute a few first differences and see if they 
are constant before using linear interpolation. 


EXERCISES VI 

1- Estimate the error in the answers to Exercises 3 and 4 of Chapter II. 

2. Compute the error in the answers to Exercises 2 , 5 , 4 , and 6 of 
Chapter IV. 



CHAPTER VII 


INTERPOLATION WITH TWO INDEPENDENT VARIABLES 
TRIGONOMETRIC INTERPOLATION 

43 latroduetion Occasionally it becomes necessary to interpolate a 
function of two arguments For example, a table of elliptic integrals con- 
tains the two arguments 0 and on both of which the ralue of the integral 
depends 

The problem of double interpolation can be solved in two ways The sim- 
plest method in theory 3 to interpolate first with respect to one variable and 
then with respect to the other In making these interpolations any one of 
the standard interpolation formulas — ^Newton’s, Stirling’s, or Bessel’s — may 
be used for either the first interpolations or the second We always choose 
the most suitable formula for the problem at hand 

44 Double Interpolation by a Double Application of Single Interpola- 
tion. This method can be explained best by means of examples 

Example 1 The following table* gives the hour angle (i) of the sun 
corresponding to certain altitudes (a) and declinations (d) at a place 
in a certain latitude Find the hour angle cortssponding to d — 12*, 


22* 


5‘ 29- 27* 
5 14 39 
4 S9 37 


8‘ 8- 48> 
4 54 17 
4 39 17 
4 23 29 
4 6 2S 


o-lO* 


a» 11- 26* 
S 55 41 
5 40 15 
5 24 50 


Solution. Here we take the entry 5^ 35" 5* as the startmg point Then 
the initial values of 4 and a are d, 15*, 0 , ~ 14* 

Let t-"/(d, a) denote the functional relation connectmg t, d, and a. 
We first find by ordinary interpolation the values of f(12®, 14*),/(12“, 18®), 
/(12®, 22®) To this end we construct the following difference tables 
correaponcling to a — 14'*, a — 18^, and a — 

* A table of this kind is called tbe /vnctton table Tbe eotriea in tbis table are 
taken from Whittaker aod Roblniona Celealoe of ObtervatuHu, p 374 
114 
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0=14” 


fid, 14°) 

l^f 



S'- 

35“ 

05* 

-15“ 09* 



6 

19 

66 

-15 26 

-17‘ 

1 

00 

« 

5 

04 

30 

-16 01 

-35 


4 

48 

29 





0=18° 


fid, 18°) 1 

A/ ’ 

A*/ 

A»/ 

S'- 14“ 

39* 






-15“ 02* 



4 69 

37 


-31' 




-IS 33 


-21* 

4 44 

04 


-52 




-16 25 



4 27 

39 





0 - 22 ° 


fid, 22°) 

4/ 

A*/ 

Ay 

4*' 54“ 

17* 






-15“ 0* 



4 39 

17 


-48* 




-15 48 


-25* 

4 23 

29 1 


- 13* 




-17 01 



4 06 

28 

i 

1 



Since the required value 1G°) of the function is near the leginning 
of the assigned values of d, ive use Newton’s formula (I) to find o). 
Purthennore, since the given equidistant values of d decrease by steps of 6°, 
we have h — « — 5° and therefore 

d—do 12 — 15 
h ” 


u 


— 6 


0 . 6 . 
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Nov substituting m (I) of Art 20 this ralue of u and the other quantities 
from table (a) above, ve hare 

/(ia° 14") - 6"35-5" + 0 e(— iifg-) + (—ir-) 

— 61‘2B“1» 

TTsing the values in table (b), ve get 

/{12'‘ 18“) — 5''14“’39* + 0«(— 16"2*) + ^ (—31*) 

^ 0 ^ e0 _ 4)(-141 

— fifcB®40' 

In lihe manner, from table (c) ve get 

/(ia“.22") -4‘34"'n" + 06(— IS"*") +1^:=^ (—is-) 

— 4‘45-21* 

The next step in the solution is to form a diflerenee table of these fane* 
tioDS just compated Hence ve have 


/(I2 a) 



26- !• 

9 6 to 

4 45 21 

21» 

-20 19 

+8* 


Nov smee the required value of the function is also near the beginning 
of the assigned values of a, ve again use Newton’s formula (I) Also, 
since the equidistant values of a increase by 4”, we have A — • 4° Hence 



Substituting in (I) of Art 20 this value of u and the other quantities 
from the tables above, ve finally get 
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16°) •= 6*>26“P + 0.5(— 20“21») + (2") 

— 5 ^ 15 ^ 50 \ 

Note. If it should be required to compute /(14°, 20°), for example, we 
would set out from the entry 5*‘55“41® and compute /(14°, 10°), f (14°, 14°), 
/(14°,18°), and /(14°,22°) by Newton’s formula (I). Then to fed 
•/(14°, 20°) we would use Newton’s formula (II), because the required 
value is near the end of the given values of a. . 

Example S. Find from a table of elliptic integrals the value of 

^ Bin-1 {12/lS) ^ 

Jo Vl — 0.78 sin® ^ 


Solution. Comparing this integral with the standard elliptic integral 
of the first kind, namely 

di<j> 


c 

Jo vl — 81 


we have 


Vl — sin®0sin®i#> ’ 


<#. ■=• sin-® ^ = sin-® (0.9230769) = 67° 22’ 48".5 
Xo 


. 67°.38014, 


sin® 6 = 0.78, 
sin 0=. 0.8831761, 

e — 62° 01' 40".4 = 62°.02789. 


In problems of this kind, where extensive tables are at hand, it is better 
to use central-difEerence formulas. Hence we write down the appropriate 
portion of the given function table, compute the necessary difference tables, 
and from them calculate the values of F(60°, 67°.38014), F(61°, 67°.38014), 
F(62°, 67°.38014), F(63°, 67°.380l4), and F(64°, 67°.38014) by means 
of Bessel’s formula (VI), because 67°.38014 is near the middle of an 
interval. Then we form a difference table from these computed functions 
and find F(62°.02789, 67°.38014) by means of Stirling’s formula, (IH), 
because here the value 62°.02789 is near the beginning of an interval. 

The function table is given below, and from it the difference tables 
following are computed. 
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*-60* 


61* 


62* 


63* 


64* 


1 3489364 
I 3772777 
1 4089999 
I 4350955 
1 4845657 
1 4944109 


1 3559464 
1 3847727 
1 4139971 
1 4436231 
1 4736530 
I 6040879 


I 3630180 
1 3923331 
1 4220753 
1 4522494 
1 482S589 
I 6139061 


1 3701309 
1 3999481 
1 4302236 
1 4609635 
] 4921723 


1 3772732 
1 4076057 
1 4384298 
1 4697532 
1 6015826 
1 6339233 
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* 

F(62°, «) 

AF 

A*P 

A»F 


A»F 

65° 

1.3630180 

293151 

j 

i 



66 

1.3923331 

297422 

4271 

48 



67 

1.4220763 

301741 

4319 

35 

-13 

+1 

68 

1.4622494 

306095 

4354 

1 

23 

-12 


69 

1.4828589 

310472 

4377 

j 




70 

1.5139061 








e 

= 63° 





F(63°, *) 

\ 

A*F 


A*F 

A‘F 

65° 

1.3701309 

298172 





66 

1.3999481 

302755 

4593 

61 



67 

1.4302236 

307399 

4644 

60 

-11 

-2 

68 

1.4609635 

312093 

4694 

37 

-13 


69 

1.4921728 

316824 

4731 




70 

1.5238552 








e 

= 64° 




* 

F(64°, *) 

AF 


A*F 

A*F 

A‘F 

65° 

1.3772732 

303325 

j 




68 

1.4076057 

308241 

4916 

77 



67 

1.43S429S 

313234 

4993 

67 

-10 

-4 

68 

1.4697532 

318294 

5060 ! 

53 

-14 


69 

1.6015826 

323407 

5113 




70 

1.5339233 







(c) 


(d) 


(e) 
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Here 

+9 — er, ^ — 67*38014, A — 1®, 
u — 0 38014 

B — u — ^-.—011986 

Sabstitutmg la Bessel’s formulii (VI) tbe quantities giren m table (a), 
ve have 

^(60®. 67® 38014) — 1 4205477 — 0 00348740 — 0 0000140S 
+ 0 00000001 — 0 00000003 
— 14170162 

III a similar iBanner ve get from tables (5), (c), (el), (e), 
r(61*, 67® 38014) — 1 4252117, 
r(62®,67® 38014) —1 4334946, 
r(6J*, 67® 38014) — 1 4418540, 

/'(64*, 67® 38014) —1 4502779 

Forming now a table of differences from these computed fumtioiis 
we hare 


9 




&>F 


60* 

1 4170162 

81955 




61 

1 4292117 

82829 

874 j 

~1Q9 


62 

1 4334946 

1 

83594 

765 

-120 

-11 

63 

1 4418540 

84Z39 

645 



64 

1 4502779 ' 




1 


For this interpolation ve bare 

6, — 62®, 6— 62® 02780, h — 1® 
e~e, 62®02789 — 62® 

j p 


■0 02780 


Substituting in Stirling’s formula, (111), tbis ralue of u and the appro- 
priate quantities from the table abore, we get 






121 


Arx. 45] DOUBLE OR TWO-WAY DIFFERENCES 

1^(62°.02789, 67°.38014) = 1.4334946 -f 0.00023208 

-f 0.00000003 -f 0.00000005 
= 1.4337268. 

45. Double or Two-Way Differeaces. Before expl ainin g the Becond 
method of dealing with the problem of double interpolation it is necessary 
to define double or two-way differences, to which we now turn our attention. 

Let Z’^f{x, y) denote any function of two independent variables x and 
y, and let Zr,=‘f{xr,y,). Let us next construct the following function 
table : 



s 


Xj 


*4 






B 

ZlO 

Zjo 

Zio 

*40 

. . . 


... 

*-0 



Sll 


Zll 

*41 



. . . 



Zoi 



Zll 

*41 




*-i 


*03 

*u 


Zn 





*-i 

yi 

Zo4 

«!» 

2l* 

Zlt 

*44 




*-4 

yn 

*0n 

^In 

Sin 

Zln 

24n 






We now define double or two-way differences as follows : 
A'*®2oo AiZoo “10 2oo, 

a' ®Zqx *=* AfZo, Zll - 
A^ A^Zq- e™ Ziz ^“2^02, 


AOtXjv , A ^ _ — 

A° *Zio •“ AyZ,o «=« Zij . — ZjQ, 

A° *2jo “■ Aj.Zi 5 "• 2n — 2*0. 


Or, more generally, 


A “rt ^ A-Zrf ““ ^r+i,» “ri, 

A”*'2r, = 


“r.f *1 2r». 
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m 

Also, 

- A»„*oo - 

— A*’*lio — A*'‘*«, 

A**«Zoo — A.'i.# — 2r,* + z„, 

A**®«oi “ Aj’««i — *,i — 2*u + *,i, 

A**®Zo» ““ A,**«« — *» — 2*|» + 2«{, 

A»‘*Zao — A,*a» — Irt — 2*.1 + *o», 

A®‘*zi« — A,»z,« — z„ — 2zu + z,„ 

A"’z,« — A,*Zja — Zfi — 2z„ + a, 9, 

A*“za9 — A***Z9, — A***z„, 

A«‘*Z9« — A*‘**,» — A***z„, 

A*’*Z99 “ Ai*Zoa " tt» ~~ 3zta -|- 3Z|9 — Zaa, 
A***Zoi " Aj*2ai “ *j« ““ 3z,i -f- 3Z|i — Zgt, 
A***Zaa “ A,*Zaa " *a» Sz** -J- Szg, — Zga, 
A*‘*Z .9 — A,*Z,a — — 3*„ + 32,, — 2,0, 

A*‘‘z., — A**®2a, — A**® 29 *, 


A“»Zoa — A/2aa — *a»— 42^ + 6*, a— 4*,» + too, 
A*“Z9, — Ag'Zaa — 2a« “4 zm + 32«, — 4z9, + fog, 
A*“z„ - A‘**2at — 2A***2 ,i + A**»z„, 

— A**‘2,a — 2A***!,, 4- A*‘*2 »o 


The general fomuls for writing down these differences is easily seen 
to be 

(I ) A— - A—*.. - nA— I, . , + '' A-'«. . . + 

4- A"**Zaa 


— A^’i'z., — mA»**z» , 0 4- ^ A**"2« 0 9 4- 

4- a®« 29 , - 


The symbol Ag^'z,,, for example, means that we find the mth difference 
of Im vixih raped to x, y being held constant 

48. A Geaeial Formula for Double lateipolation. We are now in a 
position to consider a general formula for double interpolation The 
following formula is derired m 0 Biermann’s ilfathemaltsehe NaKtrvngt 
meihoden, pages 13S 144: 
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(1) Z=‘f(x,y)—Zoo-\ r — - ^ r. ^ A'‘*^Z, 


h 

1 r(a: — Xo)(x—x{) 


+ 


h- 

(y— yo)(y— yO 
k~ 




h “ 

2(x — xo)(y — yo) 


hk 






]+■■■ 


1 r(x Xo)(x Xi)- ' -(x 3:m-l) 


+ ;^[ 


A"'*®2„ 


, m(x—Xo){x — x,)- • • (x— Im.2)(y — !/o) 

+ ^ ^o-> 

mim — l)(x — Xn)(x — x,) • • • {x — x„,.^)(y — yo)(y — yi) 
2 h"‘-^k^ 


X A('"-=)^^2oo + • • • 

+{ y-M>)(y-y.y ■ -to-g-W ..] + 

Here h and h are the intervals between the equidistant values of x and y, 
respectively, and R{Xo,yo) is the remainder term. 

This formula can be simplified by changing the variables from x and y 
to u and v, as follows : 

Put 

u = — - — , or X = Xo + hu. 

h 

Then 

^ — 3^1 X — {xo + h)_x — Xo h 

h “ h “ fe 
and 

_x— (xo+ 2A) X — Xo 2h 

~r- s 


X ■— Xm-\ 


'U — (m — 1). 


Also, put 
Then 


„ y— Vo 

“ — fc~’ y = y^ + 


y y> y — (yo + ^ y — vo i- 

k t — fc — --=r — 1, 

y~ys 
h 


V — 2, etc. 
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SuVtituling mIuc*! of (r — x*)Ai (y — yo)A> ui {!), »ac get 
(X) z *=■ /(r, y) — /(r, + hu, y« + It) — **, + «A‘*«Zo» + 

+ 2 1 *4ii® 4* + t(t — 1)A* Zoo] 

+ J , [ii(» - I){“ 2)i' + 3«(u — l)‘i' %. 

4- 3ut(t — l)A‘**2«o + t(» — 1)(» — 2)A*'*?a8] 

- [u(ii-l)(»— !)(ii — 3)l-«„ + <ii(ii-l)(«-2)tA-i. 

Cu(u — l)i{v — 1)A****,* -f 4ut(t — l)(v — 2)A'**2 o8 
+ t(v - l)(r •- 2)(t - 3)A*“x.,] + R,{za, y.), 

where 

A.f/u Jo) — — !)(*<— 2) (u — 

+ (n -f l)«(u — l)(tt — 2) {ii— (rt — l)]iA*'‘r„ 

4 —^,^ —11(11 — 1) (u — {n — 2)]i(i' — 1)A'* "*»rM 
+ l)(v — 2) (v — n)A“*'**“re»3 

This formula (\) corresponds to Newton’s formula (I) and reduces to 
that formula if «c put either umO or r^O 
In some applications of mathematics, particularly m Nangatiou, linear 
interpolation with several arguments is of considerable importance For 
(Samile in various navigation tables are tabulated the complete solutions 
of tboi oaniN uf astronomical triangles llere the one or two desired parts 
art funetions of three arguments 

tirimiias for linear interpolation with ecveral arguments are readily 
found from the genera! formula ( 1 ) and from extensions of that formula 
Thus for two argument'' after neglecting all differences higher than the 
first, we have 

(3) 2^ (S,,„)+i^(A,»..) 

J-or a function of three arguments, as « — f{x, y ,*), we have 

(3) -I (AjW®*.) + (Aytleso) T — j — (A,Wo«) , 

and 60 on for an) number of arguments 
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Anr. 46] FORMULA FOR DOUBLE INTERPOLATION 

We shall now apply formula (X) to the two examples which have already 
been worked by the first method. 

Example 5. Solve Example 1 of Art. 44 by means of formula (X). 

Solution. For the sake of clearness we repeat the function table given 
in Example 1. and work the problem anew from the start. 


d 

15 ° 

10 ° 

5° 

0 ° 


0 = 14° 


4 48 


I 


29 


18° 

5*“ 14" 39* 
4 59 37 
4 44 4 

4 27 39 


22 ° 

41. 54m 
4 39 17 
4 23 29 
4 6 28 


Forming next the necessary difTerence tables, we have 
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A'^Yoo' 

-A*%i- 


(__ 15t»93) == 7* 

A»*Voo 


-A°**/oo= 1* — (4*) 

= — 5*, 

A***/oo 

«»» A**°/oi 

-Anoo--31*— (- 

.17»)« — 14*, 

A**®/oo 

==■ A»**/io 

— A°*®/oo = 0 — O ■= 0, 

_18*)= — 3», 

A***/oo 

- AS^^/oi 

— A**^— 21* — (- 

A^'*/oo 


— 2A*»«/oi4-^**®/oo 



=» — 48* 

— 2(— 31*) 4- (— 17») = — 3», 

A^’o/oo 

«0, 



A®*Voo 

-=0. 




We have already found in Example l that 

u 0.6, V = 0.5. 

Substituting in (X) these values of u, v, and the computed difierences, 
vre get 

/(12° 16®) — 4- 0.6 (— 15™9*) + 0.5 (— 20'"26») 

+ i[0.6(— 0.4) (— 17>) 4- 0.6(7») +0.5(--0.5)(4»)] 

4- K0-6(— 0.4) (— 1.4) (— 18*) 4- 0.9 (— 0.4) (— 14*) 
4-0.9(— 0.5)(— 5*) 4-0] 

4- ^«jC04- 1:2(-0.4)(-1.4)(-3») 4- i.8(-0.4)(-0.5)(-3*) 
4-04-0], 

or /(12“, 16°) »=» 5*'15'”5Q*, as previously found. 

Example 4. Solve Example 2 by means of formula (X). 

Saluiion. Since (X) is not a central-difference formula, we do not use 
the same function table as in Example 2. From the definition of the 
two-way differences A"*"Z(,o it will be seen that the following triangular 
function table, starting from F{62°, 67°), is all that is required for finding 
all differences up to the fourth order inclusive. 


<(> 

fl»62“ 

63' 

64' 

1 

65' 

66' 

67' 

1.4220753 

1.4302230 

1.438429S 

1.4466803 

1.4549598 

6S 

1.4522494 

1.4609635 

1.4697532 

1.4786046 


69 

1.482S689 

1.4921728 

1.6015826 



70 j 

1.5139061 1 

1.5238552 




71 ! 

1.5453920 ! 
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The following difference tables arc next computed 
ai- 62 * 






1 -IS.HJ’SS 
1 4K2^)1 

1 -twwso 

1 51300GI 
1 5153920 


301711 

306095 

310172 

314839 


4351 

4377 

4387 








F* 

1 4302235 
1 4509635 
1 4921728 
1 52385S2 


307399 

312093 

316824 


4691 

4731 


ft* 

«> 1 4381298 

4 1 4697532 

I 1 5015826 






313231 

318291 


5060 
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<^0=67° 



Fea 

A''^Fot 

A'^Fbq 


j A‘‘'’Fft) 

flo 

1.4220753 

1 

81483 


j 


B, 

1.4302236 

82062 

579 - 

! 

-146 


Bt 

i 1.4384298 

82505 

433 

! 

-..,3 

3 

Bi 

1.4466803 

82795 

290 



Bi 

1.4549598 




i 


4.1 = 68'' 



Fe\ 

A'+«Ftfi 

A^-^F»i 

A’+oFfli 

Bo 

1.4522494 

87141 



01 

1 4609635 

87897 

756 

-139 

Bt 

1 4697532 

88514 

617 


B, 

1 4786046 





4.2 = 69 “ 



Fa2 


A^-’>Fe2 

00 

1.4S2S5S9 





93139 


01 

1.4921728 


95!) 



94098 


Bs 

1.50I5S26 

1 



-- A'*” Foo = 87141 — 81483 = .IG.IS. 
A' ■i'co '= A*‘-F ,0 — = 4G94 — 4354 — 340, 

A Fpj = A-*"Fp, — A-’®/'pp ~ 75G — 570 = 177, 

A’-’F„p ^ A«-’F,p _ AO'V'Vo = 37 — :>3 
A^*>Fp„ ^ a’-Fp, — a-’-oFoo = — ujn - 
A^'^Fp, A^-'>Fo, - 2A=*<-Fo, -f A-*“Fpo 

= 26. 


= Mr 

(—146) =7, 

= 059 — 1512 4- 579 


Hence 
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In Example 2 ve found ti 0 02789, v 0 38014 Substituting in (X) 
these Tallies of u, v, and the computed differences, we get 
^(62 '’02789, 67 *38014) — 1 4220753+0 02789(81483) + 0 38014(301741) 
+ i [0 02789(— 0 972U)(670) + 2(0 02789)(0 38014)(5658) 

+ 0 38014(— 0 61986){4354)] 

+ i[<0 02780) (—0 972n)(—l 97211) (— 146) 

+ 3(0 02789) (— 0 9?2n)(0 38014) (177) 

+ 3(0 02789) (0 38014) (— 0 61986) (340) 

+ 0 38014(— 0 61986) (—1 61986) (23] 

+ jly[0 02789(— 0 972I1)(— 1 972ll)(— 2 97211)(3) 

+ 4(0 02789) (— 0 97211)(— 1 97211) (0 38014) (7) 

+ 6(0 02789) (— 0 9?211)(0 38014) (— 0 61986) (26) 

+ 4(0 02789) (0 38014) (—0 61986) (— 1 61986) (14) 

+ 0 38014(— 0 61986) (— 1 61986) (— 2 61986) (— 13)] 

— 1 4337264 

Thu ralue differs from that found m Example 2 by four units m the 
lut decimal place, but in eiew of the fact that different parts of the 
function table, different formulas and different methods were used is 
the two computations the agreement la as close ai eonld be expected, 

Neit The two methods explained la this chapter are roScient for the 
talution. of all ordinary prohlema of double interpolation. Aa to which 
of these methods is preferable, it may be said that the use of formula (X) 
18 probably shorter if all differences aboTo the second are negligible 

For a more extensire treatment of double interpolation the reader should 
consult Steffensen’s InltrfoUhm, pp 203 223, and Tracts for f7ompu{eri 
No III, Part 11, by Karl Feanoo 

47 Trigonometric Interpolation. When (he function we desire to 
represent by an interpolation formula is known to he periodic, it is better 
to use tngonometne interpolation. Hennitc’s formula for interpolating 
periodic functions is 

(XI) 8in(g — »)sm(»— a,) smla — x.) 

^ ^ ^ 8in(»» — *i) •in(*, — *,) sin (a-, — a, r* 


8in(* — £»)Mn(x — *,) 

S)n(x— z,) 

sin(fi — *♦) eiD(«i — *,) 

8in(rt — r»)'‘ 

4- 

8in(* — x«>ain(x— f,) 

sinfz — x» .) 

81&(3. — a,) Sin(Xa — »i) 

nii(zs — ,) 
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This function has the period 2ir, as may be seen by replacing s by a; + 

It is evident also that y ■= yo when x — lo, y yi when s — Sj, etc. 

This formula of Hermite’s for periodic functions corresponds to 
Lagrange’s formula for non-periodic functions (Art. 27), and applies 
whether the given values of x are equidistant or not. By interchanging 
X and y in Hermite’s formula we get a formula for the inverse interpola- 
tion of periodic functions, corresponding to (27.3) of Art. 27. 

Example. Given the following corresponding values of x and y, find 
the value of y corresponding to a: »= 0.6, the values of x being in radians : 
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the log sines being giTCn directly in the Smtlhsonmn Vathemalical Tables, 
Jlyperbohc Funclions, Table 111 

i\o/e The problem of trigonometric interpolation was first solved bj 
Gauss* i^ho derived several formulas similar to Hermite’s The formula 
usually called Gauss’s formula differs from Hermite’s only in having the 
factor i written in front of all the angles, thus, am — Xo) etc It is 
believed however, that Hermite s formula is simpler than any of the Gauss 
formulas 

EXERCISES Vll 

I Using the data of Example I, Art. 44, find by two methods the hour 
angle of the sun when a — 12® and d— 16® 


Werke Band III, pp 2C5 327 
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NUMERICAL DIFFERENTIATION AND INTEGRATION 


I. NUMERICAL DIFFERENTIATION 


48. Numerical Differentiation is the process of calculating the deriva- 
tives of a function by means of a set of given values of that function. The 
problem is solved by representing the function by an interpolation formula 
and then differentiating this formula as many times as desired. 

If the function is given by a table of values for equidistant values of the 
indciiendent variable, it should be represented by an interpolation formula 
employing differences, such as Newton’s, Stirling’s, or Bessel’s. But if the 
given values of the function are not for equidistant values of the inde- 
pendent variable, we must represent tlie function by Lagrange’s or Hermite’s 
formulas. 

The considerations governing the choice of a formula employing dif- 
ferences are the same as in the case of interpolation. That is, if we desire 
the derivative at a point near the beginning of a set of tabular values, 
we use Newton’s formula (I). Whereas, if we desire the derivative at a 
point near the end of the table, we use Newton’s formula (If). For points 
near the middle of the table we should use a central-difference formula — 
Stirling’s or Bessel’s. 

The values of derivatives in terms of differences may also he found by 
means of those interpolation formulas which employ differences. Thus, 
from Stirling’s formula we have, since 


dy dy du 1 dy 


h dx du dx h du’ 


^ .v-i + ^yo , ^ 
2 "^2 


y >=- 2/0 + » — A\V-, 4 


3! 2 - 


. „ a- »(t/^-l)(u=-2=) A=y.3 4 AY 

^4! ' 51 2 

, l)0P-24 ^ 

"T f. , A y.j 4 ■ ■ ■ j 


C! 


^y_ ^ _i.r AtZ-i 4 Ayo 


dx h[_ 2 

4u> — 2u 


3u- — 1 A^y.; -|- A^y.i 


+ .A=s.,+ _ 

A‘y., -f - ^ A=y., -f A=y.., 

? o 


4! 

6u’ — 20u’ 4 8u 
61 


AY. + - • •] , 


13,1 
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A’y 1 4~ I 


20u* — 30tf A*y t + A*y , 


rf’y 1 r A«y. + A*y. , , . . , 60u«-30 A»y. + A»y, 

dx* ML 2 5^ 2 


, 120u*— 120« , T 

+ — 6i J. 




]■ 


A-y. + A-y, ^ 360V-120 ^.^_ ^ 


g-p[AV-.+ 1 

For the point x •> z, we here u — 0 Henw on lubstitutmg thu Ttlne 
o{ u IS, the formulu thtiit, ve get 


m. 

(s), 

(s), 

(&i 


1 r ^y » 4* Ay, I A*y t + A*y . 4 A*y i -f A*y , , 
"hi. 2 “a’ 2 ■*'51 2 

]■ 

1 TAV , + A*y , 30 A*y,M-A»y, 1 

" mL 2 5J 2 J' 

]■ 

]. 

-r;[AV.+ I 


Evidently we can find the denvatim in exactly the same way by dif 
ferentiatmg Newton's Bessel's, and liOgraage’s formnlaa 

To find the maximnin or minimum value of a tabulated function we 
compute the necessary differences from the given table, substitute them 
m the appToprute interpolation formula, put the first derivative of this 
formula equal to wro, and solve for «. Then x is found from the relation 
* «— x» htt. 

We can also find the mazunum or minimum value of a function by 
equatmg to zero the first derivative of Lagyai^a formula. 
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Example. Find the first and second derivatives of the function tabu- 
lated below, at the point x — 0.6. 


X 

y 

i 

A*!/ j 

A’y 

A*y 

0.4 

1.5836494 

2137932 




0.5 

1,7974426 

2467950 

330018 

34710 


0.6 

2.044237G 

2832678 

364728 

38358 

3648 

0.7 

2.3275054 

3235764 

403086 



0.8 

2.6510818 






Solution. Here Xo >= 0.6, u ■= 0, A = 0.1. Substituting in the formulas 
for the first and second derivatives at X’=Xo the appropriate differences 
from the table above, we get 

^ 10[0.2650314 — 0.0006089] = 2.644825, 

d‘V 

^ = 100 [0.0364728 — 0.0000304] 3.64424. 

The function tabulated above is 


Hence 


y = 2fi - — X — 1. 


dx 


2e’ — l, 


d^y 

dx» 


2e-. 


Putting X •== 0.6 in these, we get 


dx 


2.644238, 


d'y 

dx' 


3.644238 


^ the correct values for the first and second derivatives. The values found 
by numerical differentiation are therefore correct to five significant fibres 
in the case of the first derivative and to six significant figures in the case 
of the second derivative. 


two indepeodent vatiaHes 

can be found by differentiating partially formula (X) of Art. 46 
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n RUMERICAL INTEGRATION 

49 Introduction Nuniirital integration n» the proic*? of computing 
tie \alue of a tlofinite integral from a set of numerical values of the 
integrand When applied to the integration of a fui ction of a single 
1 inable the process is bometimes called »iec/aHifef r/uadralure , when 
applied to the computat on of a doul Ic integral of a fumtion of two 
indcpeiidont variahle's it is tailed meclamcat cubalure 

The problem of numerical integration like that of numerical differentia 
tion, IS «ohod bi reprc'enting the integrand b> an interpolation formula 
and then integrating this formula lietween the de«iTcd limits Thus to find 
file laiue of the definite integral /‘yd-r we replace the function y bj an 
interpolation formula usually one imolving differences, and then integrate 
this formula between Ihe'linfyra andli In this way we Can dern^ guadra 
lure formulns for the approximate integration of any function for which 
numerical values are known Ue shall now derive some of the simplest 
and most useful of the quadrature formulas 

50 A General Quadrature Fonnula for Equidistant Ordinates In 
Newton’s Stirlings and Bessels interpolation formulas the relation con 
necting x and u is 

( 1 ) X~T, + hu 

from which we get 

( 2 ) dx — hiu 

I.«t us now integrate Newton’s formula (I) over n equidistant intervals 
of width The limits of integration for x are and x»-f nA 

Hence from (1) the corresponding limits for u are 0 and n We there* 
fore have 


^ — 2)(»-3) ^ 1)(„ — 8)(»-31(» — 4) 


or 

(SOI) fj' 
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SIMPSON'S RULE 

From this general formula (50.1), we cun obtain a variety of quadra- 
ture formulas by putting a - 1,2,- - - , etc. The best two are found by 
putting n ■= 2 and a = 6. 

51. Simpson’s Rule. Putting ii=2 in (50.1) and neglecting all dif- 
ferences above the second, we get 

j yds. = 2i/o -F 2At/o (^3 " j 2 J 

= h [2yo + 2 t/, — 2.V0 — ~yy + yo) 1 

— |(i'o + -li/. -f I/x). 

For the ne.vt two intervals from ar- to 0^2 -j- 2ft we get in like manner 


J ^ (y, -f 4^3 -f yi) . 

Similarly for the third pair of intervals we have 

X x.»-* ft 

ydT^~ {y, + dy, + ye) ; 

and so on. .'\dding all such expressions as these from lo to x„, where n 
is even, wo get 

X re*n»i /, 

ydj" == — (t/o + ‘lyi + 3/2 4" F: + 4^3 + yi “T y« •+• “lys -f" !/o + ■ ■ ■)> 


or 


S' Jo*n» h 

(51.1) j ydx «= — (yo-l-4yi-r2y2-{-'ly3-f-2y4-i- ■ • • -}-2yn-2-i— lyr.-i-{-yn) 


[yo 4(yi 4~ ys •j' ' ■ ■ 4* y>»-i) 4* 2(y2 -F y4 4" 


Vn-z) 4* yn]- 


ft ,5. 
3 


.<^y. 


where c=»1.4, 2.- • -2,4,1. 

This impurtant formula is known a.s Simpson’s Rule. It is probably 
tile most useful of all the formulas for mechanical quadrature. 


• Since the inti'rv.nl of intfprr.'iiion Mtends only from x, to x, J- 25, there are onlr 
the fuiu-tinni.1 valuer y,, y,, y, in this interval. Hence with only three values, there 
can he no differences hipher than the second. 
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When using this formula the stndeai must bear in mind that the 
interval of integration must be divided into an even number of tub* 
intervals of width h 

The geometric significance of Simpson’s Buie is that we replace the graph 
of the given function by n/2 arcs of aecond-degree polynomials, or para 
bolas with vertical aiea 


52 Weddle's Rule Patting in (50 1) and neglecting all dif 
ferences above the sixth, we have 

J**‘*'*ydr — A ^ fiy* 4 - 18 Ay, + 27A*y, + 24A*yo + ^ A‘y, 

Here the coefficient of A'y, differa from 3/10 by the small fraction 1/140 
Hence if we replace this coefficient by 3/10, we commit an error of only 

A*y« If the value of A is aueh that the sixth differences are small, 

the error committed will be negligible We therefore change the last term 
to (3/10)A*y» and replace at! differencee by their valnee m terms of the 
given y’s The result reduces down to 
3 A 

if<f* — jQ Cr* + + y» + Cy* + + f^y* + y*] 

For the next set of six intervals from to itt «e get in the same way 

X *w 3A 

y«f* — ^ [y« + Syr + y. + 6y, -f y.. 4- 6y„ + y *] 

Adding all such expressions as thes* from z« to x„ where n is now a 
multiple of Six, we get 

X a, lU 3I. 

y^f* — [y» + hi +yi + €yi + y« + h» + 2yi + hi + yi 

+ fiyt + y« + «yn4-2y„ + 

4- 2y.-, 4 . 5y, , + jr, . + 6 y. , + y. , 4 . Sy,., 4 - y.] 


where fc — 1, 5 1, fi, 1, 6, 2, 5, 1, 6, 1, 5, 2, etc 
This formula is known as Weddles Suit It is more accurate, m general, 
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Art. 52] 


than Simpson’s Eule, but it requires at least seven consecutive values of 
the function. 

The geometric meaning of Weddle’s Rule is that we replace the graph 
of the given function by n/6 arcs of fifth-degree polynomials. 

We shall now apply these formulas to two e.vamples, chosen at random. 


yExamfle 1. Compute the value of the definite integral 




s.a 


In xdx. 


Solution. We divide the interval of integration into' six equal parts each 
of width 0.2. Hence h = 0.2. The values of the function p == In i are 
next computed for each point of subdivision. These values are given in the 
table below. 


X 

In X 

X 

In X 

4.0 

1.38629436 

4.8 

1.56861592 

4.2 

1.43508453- 

5.0 

1.60943791 ' 

4.4 

1.48160454 

5.2 

1.64865863 

4.6 

1.52605630- 




(a) By Simpson’s rule we have 

Is •= ^[3.03495299 -f 4(4.57057874) + 2(3.05022040)] = 1.82784726. 

(b) By Weddle’s rule we get 

/,r ■“ (0.3) (0.2) [3.03495299 + 5(3.04452244) 

+ 3.05022046 + 6(1.52605630)] ^ 1.82784741. 
The true value of the integral is 

/ 6-S -> S.» 

In X di x(ln x — 1 ) — 1.82784741. 

* -J 4.0 

Hence the errors are 


Es “ 0.00000015 — 15 X lO**, 
Ew-O. 


Example 2. Compute the value of the definite integral 

(sinx — lnx + c*)dx. 
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iSoIuhon We shall divide the uteml of integration into twelve equal 
parts by taking A 0 1 The valnes of the function y •• sin z — In z e* 
are then computed for each point of subdivision These values are given 
in the table below 


0 2 3 02931 
0 3 2 84933 
0 4 2 79754 
0 5 2 82130 
0 6 2 89759 
0 7 3 01465 
0 8 3 16605 


0 9 3 34330 

1 0 3 55975 
1 1 3 80007 
1 2 4 OG984 
1 3 4 37050 
1 4 4 70418 


(a) By Simpson’s rule 

/# — ^f3 02951 + 4 7Q4I8 -f 20418)+ 2( 16 49077)] — 4 OStQg 

(b) By Weddle’s rule 

7y-.0Q3[ai 05841 +5(13 58281)4- 0(6 62137)4-2(3 16605)1— 4 05098 
The true value of the integral is 

/ — J* (sm z — Inz + e*)<fz — — cosz — z(liiz — 1) + «* J 
— 4 05095 
Hence the errors arc 

Ta — — 0 00011, 

£,p_._ 0 00003 

It will be noted that Weddle’s rule is more accurate than Simpson’s m 
both examples 

Although Weddle’s rule is simple in form and very accurate, it has the 
disadvantage of requiring that the number of subdivisions be a multiple 
of SIX This means that when computing the values of y in many problems 
the assigned values of z can not be taken as simple tenths, as was done in 
the i-ft 0 examptes -wirthei aWve The sub’Amsion hj tenths is nearly atways 
possible when using Simpson’s rule However, when Simpson’s rule can 
not give the desired degree of accuracy, Weddle’s rule should be used 
When several values of the laaetion are given, as in the above examples, 
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ILLUSTRATIVE EXAMPLES 

it is better to make the computation in tabular form, as shown below for 
Simpson’s rule in Ex. 1. 


X 

Inx 

c 

clnx 

4.0 

1.38629436 

1 

1.38629436 

4.2 

1.43.508453 

4 

5.74033812 

4.4 

1.48160454 

2 

2.96320908 

4.G 

1.52605630 

4 

6.10422520 

4.8 

1.56861592 

2 

3.13723184 

5.0 

1.60943791 

4 

6.43775164 

5.2 

1,64865863 

1 

1.64865863 

.... — A f> 




27.41770887 X ~ “ 1.82784726. 


The reader is cautioned against thinking of quadrature formulas as 
simply methods of computing areas under curves. These formulas are 
Tnetkods /or computing the values of definite integrals. They give areas 
only when the integrands are the ordinates of a curve. The integrand may 
be any function of x, provided it is known for equidistant values of x. 
This fact is illustrated by the following example. 

Example S. Find by Simpson’s Buie the coordinates of the centroid and 
the moment of inertia about the x-asis for the plane area shown below. 


Y 



Fig. 2 


Solution. The formulas for the centroid give 

/o - (V3) (Joyo -f 4x,y, -f 2x,y , -{-•••) __ Sexy 

dA 1 / dx {V3)(yo + 4yi + 2^^ -f • • •) “ 5cy 

- , St r ih/i){yo^ + -f . S cv» 

dA ydx'“2 (/!/3)(yo-f4yi + 2yi + ---) ^2 cy 
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Since the moment of inertia of a rectangle about its base is tA’/S, the 
moment of inertia of the elementary area y <fr about the x axis is y*(fi/3 
Hence for the vhole area we have 

/. - 1/3 /; y' ix - 1/3 X (A/3)(y/ + 4?.* + 2y*' + ) - (V9) 2cy* 

The compntation form for this example is therefore as shown below 
J y jy y* y* c cy Cjy cy* tf 

** yo *«y» y«* y«* i y» *«y» y«* y»’ 

*1 yi *iy» y»* yi* 4 4y, 4z,yi 4yi* 4y,* 

y* a:*y* y>* y«* 2 2y, 2j,y, 2y,* 2y,* 

I* y. *iyi y.* y.* 4 4y, 4z,y, 4y,* 4y,* 


Si s, s, s« 

Hence 

*-S,/5„ 5-45,/S„ /A-(V9)5i, 
where the S s denote the sums of the nombers m the columns abore them 
Any other example can be handled in a eimilar manner after it has been 
set up as a definite integral 

Vote I By putting n — 1 is (SO 1) and neglect 
ing all differences above the first, we can derive a 
simple but crude formula known as the Trapezoidal 
Role This formula replaces a curve by a senes of 
chords For small values of A it will give fair results, 
but it is inherently too inaccurate for genera] use 
For this reason it is not considered in this book 
Volt 2 A quadrature formula derived from an 
algebraic polynomial will not give a reliable result in 
regions where the graph of the given function is veiti 
cal, because an algebraic polynomial is never vertical 
and therefore cannot be made to coincide with a verti 
cal segment of a curve A simple and satisfactory way 
of handling such a case is to replace the curve in the 
vertical region by a parabola having a honsonta] axis 
Thus, for the curve shown in Fig 3 we replace the arc 
}iP by an arc of the parabola y* “ 2px Tten the 
area of the segment MPN is (2/3)xiyi 

93 Central Difference Quadrature Formulas By integrating Stirling’s 
and Bessel s interpolation formulas we can derive rapidly converging quadra 



M N 

Fig 3 
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turc formulas in- terms of differences. Thus, integrating Stirling’s formula 
from I = So — ^ to s = So + A, or « = — 1 to u = 1, we have 


“X* (y° + ^ 2^ y 


. «(«- — 1) A=>y.i + A=y,, , «*(«= — !) 

+ 3! 2 + 4! 


+ 


u{u- — 1 ) (U- — 4 ) A=*y.a + A=^y.; 
5! 2 


.1 [2!/. + 1^=5-.+ 1(1 -5)iV. + 4(-l 

[■/. + -1 A=y-. - jL iV= + i'y-. + • • • ] 


du 


720 V 7 ^ 3 




.2A 


This formula gives the approximate value of the integral from s = So — h 
to s«=So By advancing the subscripts of the y’s by one unit we get 
the value of the integral from s = So to x==Xo + 2h. Denoting this 
integral by It,', we have 

The integrals I-*, are likewise seen to be 

t,‘ - 21 [ !,. + liV. - A-j. + ^ A-j,.] , 

- 2* [ S. + I A=s, - ^ A-s. + A«!,=] . 

•f"n-J “* 27l I pn-i -{- —A^Vn-i A^Vn « -1 — — A*t/ "] 

L* ^6 180 ^ '^1512 

Adding all these separate integrals, we get 

(63. 1) Jo" ■=» 2h yj yj 

-f 4- H -f A'y„.t) 

1 


180 + • • • + AV.-s) 

1512 4- AVo 4- A*yi + • . . A«y„.,) J , 
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and n is even 

Integrating Bessel’s formula (VI) orer the interval * — To to * ■- ar* -f fc, 
or V — — I to V — we have 

^ — i) . (c»-. — j) A«y, + A*y, 




K r ^° + y* - L A*y. + A»y, II A*y » + A*y , 

"La 12 2 "^720 2 

191 A*y , + A*y n 
“ 60480 2 J 

B/ advancing the subscripts a onit at a time we find tbs integrals over 
the succeeding intervals to be 

.._,r yj+y» i Jj av. + a^. 

'• La 12 2 ^720 2 

_ 191 A*y » + A*y , ~t 

60480 2 J ' 

/ 1 A f y* + y* _ i. ^*y« + A^yi » Jl. A*y» + A*y 

* ” L 2 12 2 '^'■20 2 

191 A«y , 4- A»y, -1 
” 60480 2 J ’ 


\ f y* » + y- _ ^*y- » + ^*y» ■ • A«y, , 4- A<y. : 

“‘""La 12 2 *^ 720 a 


191 A«y. . + 


Adding all these separate integrals, we get 
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= +!/: + ■ ■ ■ + 

+ -{ 2^} 

-f <^^yn-s + ^"f^) 

- ^ AV- 4- A®!/-) -f • • ■ 

60480 \ 2 ^ ^ ‘ ^ ' 


+ AV. + ^)], 


whore n is now either even or odd. 

It will be observed that formulas (53.1) and (53.2) involve only 
differences of caen orders, that (53.2) involves all the even differences, 
whereas (53.1) involves only half of them. Formula (53.2) is too 
cumbersome for practical use as it stands, but it can be transformed into 
a much simpler and more useful fonn, as wo shall now show. 

From the definition of differences we have 


A'y., ■= Ajo — Ay.i, 
A=t/o = Ayi — Ayo, 


A-y„.i = Ay„ — Ajfn.i, 
== A’y., — A®y.s, 
A^y., = A*yo — A’y.„ 


A^y„-2 ■= A*y„.i — A*y„.;, 

Ay 3 = Ay I — A’y.s, 

Ay I = A*y., — Ay,, 

A®y„.3 -= A=y„., — A*y„.3, etc. 

Substituting in (53.2) these values of the even differences, we find that 
all differences e.xcept those at the beginning and end of the table cancel 
one another and that formula (53.2) reduces down to 
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11 M’v. + a'gA . 191 / AV. + A‘v, \ 

720 ^ 2 / 60480 \ 2 / 

_ 1 / Ay>..4-^y. \ I 11 /' A*y^,+ A«y^. \ 

12 V. 8 /■*^720V 8 / 

__ 191 / A«y.4+A*y.A -1 
60480 V 8 /J ’ 

which cao be written in the aimpler form 


^ 2^ ■f' + y* + 


1 /A,v*.i + Av« Ay 

. + Ayo\ 

18^ 2 

8 / 

I n /A'y*., + AV.. 

A»y, + A'yj\ 

r20V 2 

8 J 

191 /A'v,, + A»v., 

A'y . + A».y A 

60480 V 8 

8 J 


The resulU given by tbie formnla are identical with those given by 
(63 8), but the labor involved in obtaining them la only a imaU fraction 
of that re<}uired when using (63 2) 

The geomeinc significance of lononlaa (63 1), (63 8), and (63 3) 
should be noted Formula (63 1) replaces the graph of the given fane 
tion by n/8 arcs of polynomials of the sixth degree, whereas (63 2) and 
(63 3) replace the graph by n arcs of eixtb degree polynomials 
By neglecting fourth and sixth differences in (63 1) and replacing the 
second differences by their valoes in terms of the Jr's, we shall find that 
(63 1) then reduces to Simpson’s Buie Tbit formula therefore represents 
Simpson’s Hule with correction terms 

We shall now apply (63 1) and (63 3) to two examples 
Example 1 Compute the value of v from the formula 

z r* ^ 

4 J, l + x» 

iSolttlion We first compute the values of the function y — 1/(1 + **) 
from X — — 03 to i — 13, taking 4 — 01, and then form a table of 
difference as shown on the following page 
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Substituting in (63.1) the appropriate differences, we have 


^ - 0.2[3.9311573 + | (— 249992) _ A (_ 7 ) + ^( 778 )] 
— 0.78539816. 

T ^ 4 X 0.78539816 ■=== 3.14159264. 

The true value of to nine figures is 


TT = 3.14169265. 


Difference Table for j/ = l/(l't-x*.) 


X 

y 

Ay 

A*y 

A‘y 

A‘j/ 

AV 

A'y 

-0.3 

0.9174312 









441073 






-0.2 

0.9615385 


-155468 







285605 


-31127 




-0.1 

0.9900990 


-186595 


4-19702 





99010 


-11425 


4-3148 


0 

1.0000000 


-198020 


4-22850 


-6296 



- 99010 


4-11425 


-3148 


0.1 

0.9900990 


-186595 


19702 


-4762 



-285605 


4-31127 


-7910 


0.2 

0.9615385 


-155468 


11792 


-1320 



-441073 


42919 


-9230 


0.3 

0.9174312 

% 

-112549 


2562 


4-1886 


1 

-553622 


45481 


-7344 


0.4 

0.8620690 


- 67068 


- 4782 


4-3323 



-620690 


40699 


-4021 


0.5 

0.8000000 


- 26369 


- 8803 


3085 



-647059 


31896 


- 936 


0.6 

0.7352941 


4- 5527 


- 9739 


1983 



-641532 


22157 


4-1047 


0.7 

0.6711409 


+ 27684 

i 

- 8692 


868 



-613848 


13465 


4-1915 


0.8 

0.6097561 


41149 


- 6777 


86 



-572699 


6688 


2001 

0.9 

0.5524862 


47837 


- 4776 


— 299 



-524862 


1912 


1702 


1.0 

0.5000000 


49749 


- 3074 


— 416 



-475113 


- 1162 


1286 


1.1 

0.4524SS7 


48587 


- 1788 





-426526 


- 2950 




1.2 

0.409S361 


45637 







-3S08S9 






1.3 

0.3717472 
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Substituting in (63 3) the appropriate differences from the table, we 
get 

^-01p84a8150_i(— 4M58S)4- ^(375) 


-4X0 78539817 — 3 14159268 


This value is slightl; leas accurate than that obtained bj (53 1), but 
either result is correct to as many figures as were used in the computed 
ordinates 

Simpson’s Rule gives for this problem the value 


,^ 314159260 , 


which IS likewise correct to as many figures as are given in the computed 
ordinates 

Example £ Compute the approximate value of the integral 


-X'f 


Solution Taking «e compute the values of y^l/x at one* 

tenth unit intervals from s>w07tO7 — 23 and form a table of differences 


Substituting in (63 1) the appropriate differences, we get 

/ — 0 2[3 45953943 + 1 (3727034) — ^ (281353) 

+ (61266)] — 0 693147185 

The correct value is In 3 — 06S3147181 

Substituting in (63 3) the sppropriste differences from the table, we 
get 

7 _ 0 1[6 93771403 — -i (7594744) + i (593339) 


It Will be seen that formula (53 1) gave the more accurate value m 
this example as was the case in the preceding 

Concemmg the relative merits of formulas (53 1) and (53 3), it may 
be said that (53 1) converges more rapidty and is therefore slightly more 
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accurate. It utilitizes fewer ordinates outside the range of integration 
than does (53.3). Formula (53.1) requires that the number of sub- 

Difference Table for y = \/x. 


0.7 
0.8 
0.9 
1.0 
1.1 
1.2 

1.3 

1.4 

1.5 

1.6 

1.7 

1.8 
1.9 
2.0 
2.1 
2.2 
2.3 

intervals be even, and also requires a little more labor in its application 
than does (53.3). 

Formula (53.3) has the advantage of being applicable to any number 
of Eubintorvals and of requiring verj- little labor in its application It 
also gives the same degree of accuracy with third or fifth differences as 


Ay 


a’y 


Ahj 




A‘i/ 


aV 


1.42857143 

1.25000000 

1.11111111 

1.00000000 

0.90909091 

0.83333333 

0.75923077 

0.71428571 

0.66666667 

0.62500000 

0.5SS23529 

0.55555556 

0.52631579 

0.50000000 

0.47619048 

0.45454545 

0.43478261 


-17857143 
-13888889 
-11111111 
- 9090909 
7575758 
6410256 
5494506 
4761904 
4166667 
3676471 
3267973 
2923977 
2631579 
2380952 
2164503 
1976284 


3968254 

2777778 

2020202 

1515151 

1165502 

915750 

732602 

595237 

490196 

408498 

343996 

292398 

250627 

216449 

1SS219 


-1190476 
- 757576 
• 505051 
349049 
249752 
183148 
137365 
105041 
81698 
64502 
51598 
41771 
34178 
28230 


432900 

252525 

155402 

99897 

66604 

45783 

32324 

23343 

17196 

12904 

9827 

7593 

5948 


-180375 

- 97123 

- 55505 

- 33293 
■ 20821 

■ 13459 

• 8981 

• 6147 

• 4292 

• 3077 

■ 2234 

■ 1645 


83252 

41618 

22212 

12472 

7362 

4478 

2834 

1855 

1215 

843 

589 
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(63 1) giTes with fourth or sixth differences Its chief disadrantage u 
that it Titilizes several ordinates outside the range of integration 

The extra intenal ordinates required in formulas (53 1) and (63 3) 
can usually be found by computation, as in the examples worked above, 
or by extrapolation b} means of Newton’s formulas (I) and (II) Usually, 
however, it is not safe to use extrapolation for finding more than one 
ordinate at each end of the range 

s^Sl. Gauss's Quadrature Formula. The moat accurate of the quadra- 
ture formulas in ordinary use is known as Gauss’s formula In Simpson’s 
and Weddle’s formulas the ordinates are equally spaced, but it oceuned 
to Gauss that some other spacing might give a better result Hence he 
set for himself this problem 

If the definite integral J^*/(*)<fx is to be computed from a given number 
of values of f(x), just where should these values be taken in order to get 
a result of the greatest possible accuracy’ In other words, how shall the 
interval (o, 6) be subdivided so as to give the best possible result? 

It turns out that the points of subdtiision should not be equidistant, 
but they are aymmetncally placed with respect to the midpoint of the 
interval of integration 

Let / «■ /,*ydx denote the integral to be computed, where y — f(s) 
On changing the variable by the substitution 

( 1 ) 

the limits of integration become — } and { The new value of y u 

y — /(*) — /[(6 — + — 0(«), Bay 

y 

Then since dr — (h — a)du, the integral becomes 

(2) 7 — (6 — a)J^ ^(«)tfu 

Gauss’s formula is 

(54 1) I- f!5('<)i“-«rf(«.) + i(rf(».) + «.4(«.)+ +i!rf(u.), 

-i 

where Ui.Uj u, are the points of subdivision of the interval u — — J 
to u — i The corresponding values of x are therefore 


a + b 
2 


, etc 


a;,_ (5 — a)ui 
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The value of the integral is therefore 

(64. 2) j ^f{x)dx = (5 — a)[jR,^(«,) + Ri4>{:ih) + • • • + ■Kn<^-(«n)]• 

We shall not give a detailed derivation of Gauss’s formula (64.1), but 
merely show how the values of «-,••• u„ and i?,, R^, • • • R„ are found 
and then show how to apply it to an example. 

We assume that <#>(«) can be expanded in a convergent power series 
in the interval « = — 4 to u — ^. Hence we write 


(3) <f>(u) = flo + + “3«* + • • ' + o-mU”' + ■ ■ ‘ • 

We also assume that the integral can be expressed as a linear function of 
the ordinates of the form (54.1). Integrating (3) between the limits 
— I and I, we have 


(4) Zi= J'%(u)fiu= J"^(ao + «!« + • • • + • ■)du 

-}* ■ • • . 


^o + ~a, + ^a, 


448 


(ta 


2304 


From (3) we also have 

^Oh) ■= Ofl “f" 4* UjUi* AjUi* 4- diUi* 4" ■ ■ * 4“ flirt'll” 4“ ' ' ■ > 

= Oo 4- dlUz 4* 0^“:* 4- 4* 4- ' ' • 4- 4- • ‘ > 


*= Oo 4- a,ti„ 4- OiUn® 4- • 4. ar,u„” 4- • • • . 

Substituting in (64.1) these values of ^(«i), ^(Wz), • • •«^(«b), we get 
I •= Riido 4- a,«i 4- OjUi* + • . • -I- 4- • • •) 

4- JZ:(oo 4- OiUz 4- a-«-* 4- • • • + a„Us" 4- • • •) 


4- ^r.(ao 4- 4- 4- • • • 4- OnUn" 4” ’ * •), 

or, rearranging, 


(b) /«= flo(2?i 4" -^s 4" 4“ ’ ■ *4"J^2n) 

4- Oi 4- 4- ■ * • 4- -Kn^n) 

4* (h{R\‘di‘ 4- 4’ ■ * ■ 4" 


4- art{Rtv>,^ 4- e.-UtT 4- ■ • • 4- 
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Now if the integral I in (5) u to be identically the same as the 7 m 
(4) for all Talues of ap Aj, etc , that is if (5) is to be identical with 
(4) regardless of the form of the fanction ^(u), then corresponding 
coefdcients of ae, Oi, at, etc in (6) and (4) mn't be equal Hence we 
must hare 


(54 3) 


TfjUi 4- 4* 

•RiWi* 4- -B**!** 4" B»«»* 4* 
Bi«,* 4- Bju,* + B,«»* 4- 
B,«i‘ 4- B,u,* + B,u,« 4- 


4-^.— 1, 
4- B.u, — 0 
4- 

4-B*u.*— 0, 
4* B.tA,* •— , 


By taking 2n of these equations and soleing them simultaneously, it 
would be tbeoretically possible to find the 2n quantities Ui, u», u. and 
Ri Bt B. Howerer, the labor of soWing these equations by the 
ordinary methods of algebra would be quite prohibitive even for small 
values of r Fortunately a formula from higher mathemstics makes such 
labor unnecessary 

It can be shown* without difficulty that if ^(v) is a polynomial of 
degree not higher than 2n — I, then «!,«> u. are the zeros of the 
Legendre polynomial P»(u), or the roots of P*(u) 0 These roots are 

conveniently found from the equation 

(6) 

The n roots u„ v, uu of Ibis nth degree equation are all real On 
substituting them in (64 3), we can find the Bs We shall do this for 
the ease n — 3 
The equation to be solved is 

^ [u’ -«)’]■- 0 ^ (“• - 3u‘Ci)- + 3o>{W -«)■)- 0 

Performing the diSerentiationa and simplifying, we get 
«(20u* — 3) — 0, from which 
u — 0, ± iy/s/o 

Bence 

u, — — «i— 0, u, — IVsTs 

* See lor exsraple Todliuoter ■ nmelfont e/ Laplace Lami and Beeiel p 99 
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. Then from tlie first three of equations (54.3), Tve have 

Hi -{- Hz Jis = 1 

i?i (— i V'W + -R 3 (i VW = 0 

i?x(- iVV5 )--f-i?3(iVW 

Solving these equations, "n’e find 

/?j,= 5/18, i?i = 4/9, i?3 = 5/18. 

It is to be noted that the u’s are symmetrical!}' placed with respect to 
the midpoint of the interval of integration and that the R’s are the same 
for each symmetric pair of u’s. Hence from now on the u’s of the points 
of division will be designated by «o for the midpoint, w-i for the pair of 
s}Tnmetric points nearest the midpoint, «,2 for the next pair of symmetric 
points, etc. 

The numerical values of the li’s and corresponding R’b for n = 2 to 
n = 10 are given in the table below, where the notation of the form 
■= *V means — u.t, — — N. 


u 


R 


n •= 2, 

r 



= 0.2886751346 


n-=3. 


Uo ■= 0 

R^i/9 


u,i = 0.3872983346 

R = 5/18 

n «= 4, 


u-x = 0.1699905218 

R = 0.3260725774 


ti,2 «= 0.4305681558 

R = 0.1739274226 

n ■= 5 . 


Uo 0 

R =» 64/225 


u,i >= 0.2692346551 

R = 0.2393143352 


ic., = 0.4530899230 

R ■= 0.1184634425 

n G. 


u,i «= 0.1193095930 

R = 0.2339569673 


0.3306046932 

R = 0.1803807865 

n — T. 

tUs •= 0.4662347571 

R = 0.08566224619 


no~ 0 

R = 0.2089795918 


«=> 0.2029225757 

I? = 0.1909150253 


•= 0.3707655928 

R = 0.1398526957 


u.j 0.4745539562 

R = 0.06474248308 
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IM 


Uu ~ 0 0917173312 
tx., •» 0 2627662030 
u„ — 0 3983332387 
u,« 0 4601449282 

u. — 0 

— 01621267117 
u., _ 0 3066857164 
u., — 0 4180155537 
u., — 0 4840801198 

ii.i — 0 0744371695 
0 2166976971 
— 0 3397047841 
u,«^ 0 4325316833 
u„ — 0 4869532643 


R 

^ — 01813418917 
i; — 01568533229 
^ — 01111905172 
— 0 05061426815 

£ — 0 1651196775 
£ — 01561735385 
£ — 0 1303053482 
£ — 009032408035 
£ — 0 04063719418 

£ — 01477621124 
£ — 0 1346333597 
£ — 0 1095431813 
£-0 07472567458 
£ — 0 03333567215 


2fci« Tot furtbt 


T tibles re}4tu)|r to Gansa’s qsadratsfe fonsala the 


reader ahould conanlt the lollowinj;: Steratare 


1 " Table of the Zeros of the Legendre Polfoomiala of Order 1 16 and 
the Weight CoeSeienta for Qaasg’s Uechanical Qoadratnre Formula,*’ by 
A. 14 Lovan, Norman Danda, and Arthur LeTiiuon BnlleUn of The 
American Usthematical Society, Vol 48, No 10, pp 739 743, October 
1942 

Thu u the moat extenaire table of the zeroe and Gaoas coefficients that 
has yet been published All numbers are giren to 15 decimal places. Tbii 
table gires the eubdiruion poiota for the uiterral u — — 1 tou — 1, and 
the Tsdnes of u and £ mnst be divided by 2 to agree vrith those given in 
the table above 


2 Falfur Approxxmahve d'«»» Integrale Definit, by B P Moors, Paru, 
1905 Thia la the most comprehei^Te vork on approximate quadrature 
that haa ever been written The roots and coeffiaents for the Gauss formula 
are given for n — 1 to n — 10 to 16 decimal places The complete formula 
and its graphic representation are also given for each value of n 
We shall now apply Gauss’s formula to a ‘simple example 
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^^xample. 


s. 


I X 




'V' 

"n 


SoMion. Here we put ‘ 
1=1 

i 1 

^ “ a; “ 7« + 8.5 
Taking n •= 5, we have 

1 


(h — a)u ~ + 8.5 

/ 


yo -= <^(«o) = fg = 0.117647059 
yi-°^(ui) 

ys — ^(«i) 


■ " 7ui + 8.5 

1 

10.3846426 

1 

7w.i + 8.6 

6.61535741 

1 

1 

7i£2 + 8.5 

11.67162946 

1 

1 

' 7tt.* +• 8.5 

5.32837054 


0.0962960439 
= 0.151163412 
= 0.0856778399 
= 0.187674636. 


Substituting these values in (64.2), together with the corresponding 
R'b for n — 5, we get 

/ — 7[^ X 0.117647059 + 0.2393143352(0.161163412 -{- 0.0962960439) 

+ 0.1184634425(0.187674636 + 0.0866778399)], or 
la 0.876468468. 

The true value of the integral is 


/. 


” — =1 In ^ =1 In 2.4 — 0.876468737. 

5 2? O 


The error is therefore 

Eo “ 0.00000028. — 

The value of this integral by Simpson’s Eule, using fifteen ordinates, is 

Js — 0.87547189. 

The error in this case is therefore 


Es — 0.0000034, 
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or more th&n ten tiroes as great as with Gauss’s formula. The labor 
required to find the integral by Gauss’s formula is, howerer, manj times 
as great as with Simpson’s unless a computing machine is used 

Note The distance m z units of any point Ui from the midpoint of 
the interval of integration is (i— -a)u< 

To prove this, let b — a-~Z> and tabe the midpoint of the interval as 
origin of coordinates Then the limits of integration for z are — L/2 
and L/2 On substituting — L/2 for a and L/2 for h in the trans 

formation formula z— (6 — + get 

xm~Lu^ (t — a)u 

Gauss’s formula is useful for another purpose besides compntmg definite 
integrals Becalbng that the mean value of a function is given by the 
formula 



we see that the accuracy of the mean depends on the accuracy with which 
the integral //yic can be computed The most aecnrate value of ihu is 
obtained by meuoring ordioat^ at the points given by Gauss’s formula. 

Thus, if we wished to find the best value for the mean daily tempera 
ture from only four measuTements, we would proceed as follows 

Denoting temperature by T, the hour of the day by (, and talang noon 
as the middle of the day, we have 





Taking noon as the midpoint of the 24 hour period and remembering 
that the time measured from noon u 24u, we have for n » 4, 
t, — 24u, — 24(0 16999) 4 ‘‘0798 — 4‘> 4 "8 

t , ~ 24u 1 24(—0 16999)-— — 4<> 4 "8 

t, — 24u, — 24(0 430568) — 10 •‘3336 — lO^* 20” 

The best times during the day to take measurements are therefore 
t 40 A M 7 65 A K 4 05 p K . and 10 20 P M 
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In a Bimilar manner "we could find the best times of the day for making 
five, six, or any other number of measurements by taking the proper u’s 
for n »= 5, 6, etc. 

The same metliod can be applied for finding the best positions or times 
for taking measurements on any other physical quantity. 

Remarl-s. 1. The reader should bear in mind that Gauss’s formula gives 
an exact result when f{x) is a polynomial of the (Zn — l)th degree or lower. 

2. Although Gauss’s method is theoretically beautiful and of great 
accuracy, it has the disadvantage of being laborious in its application, for 
three reasons; 

(a) If the limits of the given integral are not — J and -J, the integral 
must be transformed to one that has these limits. The transformed integral 
is usually more complicated thau the given one. 

(b) If the values of y are to be computed from a formula, the numerical 
values of u to be substituted in the formula must be given to at least as 
many significant figures as we wish to obtain in the y’s. 

(c) After we have found the y’s to the desired number of significant 
figures we must multiply them by iZ’s having at least as many figures. 

Gauss’s formula thus compels us to deal with large numbers in every 
step if we desire the accuracy it is capable of giving. In applying this 
formula it is therefore imperative that we use every available aid for 
reducing the labor of computation. Whoever doubts this statement has 
only to work out a simple example to be convinced. 


3. Gauss’s formula should be used for computing definite integrals only 
when few ordinates are obtainable or when the importance of the result is 
such as to justify a great expenditure of labor. 


55. Lobatto’s Formula. The reader will have noticed that Gauss’s 
formula does not contain the values of the function at the end points of 
the interval of integration. In certain types of problems it is highly 
advantageous to utilize the end values of the function. Lobatto * therefore 
modified Gauss’s formula so as to include the end values and also the value 
of the function at the midpoint of the interval. The modification con- 
sisted in finding the points of subdivision (including the midpoint and 
the end points of the interval) from the equation 

where n denotes the total number of values of the function to be utilized 


*Le*itn over de Integraal-Kehening, |207-210. The Hague, 1852. 
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(including end values and midpoint values) The values of u found from 
this equation are then substituted in equations (S4 3) to find the corre 
eponding R’i We shall derive Lobatto's formula for the case n •• 6 


^Vhen n — 5, (1) becomes 




^ [u- -4«-(i)> + + (J)‘] _ 0 


On performing the indicated differentiations and simplifying, ve get 


— 40a* + 3) — 0, 

from vrhich 

u — O, ±1V3A ±1 

Hence 

ui — — i, — W3/7. wj — 0, u. — iVsT?, «» — i 


Oo substituting these values of u in the first five of equations (34 3) and 
solving for the ff’a, we find 

— — 43/180, B,- 16/45 

Hence Lobatto's formula for n •» 5 is 

[g,.+ ^„. + „)+i(y. + J.)]. 

The values of u and R for several values of n are as follows 


u 


B 

u,~0 


iJ — 2/3 

u,.-i 


5 — 1/6 

u, — 0 

R 

— 16/45 — 0 355556 

«„ _ i VS/T —0 327327 

R 

— 49/180 — 0 272222 


R 

— 1/20 — 005 

— 0 

R 

— 0 2438097 

u,i — 0^344245 

R 

— 0-2158727 

u., — 0 416112 

R 

— 01384129 

u., 0 5 

R 

— 0 02380951 
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U 

B 

n«= 9. 

o 

I 

R -= 0.1857593 


=■ 0.1815585 

R = 0.1732142 


tu, -= 0.338593 

R = 0.1372695 


u,, = 0,449879 

B = 0.08274774 


= 0.5 

i?== 0.0138889 

n sas 11. 

Uo *= 0 

P = 0.1501037 


= 0.147876 

R = 0.1434397 


= 0.282617 

B = 0.1240270 


= 0.392242 

P = 0.09358390 


= 0.467000 

B = 0.05480614 


u,5 = 0.6 

= 0.009091366 


These values are to be substituted in formula (54.2). 

Lobatto’s formula is less accurate than Gauss’s for the same n, but it is 
frequently more convenient for use. If 'the function happens to be zero 
at the ends of the interval of integration, as is frequently the case, the 
end values do not have to be computed. The computation is thereby 
shortened. 

Example. Compute by Lobatto’s formula the value of the integral 

J B s’ 

for n 5. 

Solultotv. The integral must first he transformed so that the limits 
become — f and |, just as was done when using the Gauss formula. Prom 
the previous example we have 

x^7u + 8.5, y^l/x, - 

Hence 

yv — 7(0.327327) + 8,5 10^79129 0.09266725 

y-, — ~ 7(_ 0.327327) +8.5 “ 6.20871 
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, 1 1 

+85 18 

y» — «(« ») — 7{— 0 5) + 8 6 ■" T* 

Hence 

The error in this value is 0 00016 

56 Tchebycheff’s Formula. Tchebjchefl * devised a quadrature formula 
IQ vbich the coeflicients of the are all equal His formula is 

(1) f ^(u)«iu-- (l/ft)[^(u,) + 4 (u,) +^(ui) + +^{«»)]> 

*'-1 

and therefore 

(2) W(«.) +•♦(«,) +*(ti.) + +^W] 

The points of subdivision of the interval of integration are symmetncally 
placed vith respect to the midpoint of the interval The u's are the teros 
of certain polynomials, the first fev of which, equated to sero, are* 
(2u)*— 1/3— 0 
(2u)‘ — 0 
(2u) * — (2/3) (2u)* + 1/45 — 0 
(2u)» — (6/6) (2u)* + (7/72) (2«) - 0 
(2«)«— (2u)*+ (l/5)(2a)* — 1/105 — 0 
The values of the u’s for n — 2 to n — 7 and n — 9 are 
n — 2 u.i — 0 2S6675 
n— 3 — 0, u,] — 0 363653 

n — 4 u„ — 0 0937962, u., — 0 397327 
n — 5 Ug — 0, u,,— 0167271, «.« — 0416249 
n — 6 u„ — 0133318, u„ — 0211259, u.» — 0 433123 
n — 7 11,-0, u„ — 0161956, «>, — 0 264828, u., — 0 441931 
n — 9 u« — 0, — 0 0839531, u„— 0 264381, u„ — 0 300509, 

U.4 — 0 455795 

*P Tdiebichef, “Sur lea Qusdrstarea ' JnrMl tie Halhemahguei, 1874, p 19 
tloioe cl the ouiBerfc*! reluea ca p 29 of tkst paper are Iseorrect 
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Tchebycheff’s formula can be derived directly in terms of the y’s at 
the points of subdivision, by means of the poljTiomial function 


(3) y •==. flo + OiS + Oji* + flsa:® + a^x* + Os®* + a^x'^ + + Ss®*- 

In deriving the formula we require that two conditions be met: (1) the 
coefficients of all y’s are to be the same, and (2) the points of subdivision 
are to be symmetrically situated with respect to the midpoint of the interval 
of integration. 

Take the midpoint of the interval as origin, let ®i, — ®i, ® 2 , — ^ 2 , etc 
denote the distances from the origin to the points of subdivision, and let 
yi) — Vu y 2 , — ys, etc. denote the corresponding functional values. Then 
if A denotes the area under the graph of (3) in the interval of integration, 
it is evident that for the case of nine subdivision points the required con- 
ditions are satisfied by the equation 

(4) k{yo + yi -1- y-i + ys -f y.i + ys H- y-s + y4 + y-^), 

where h denotes the common coefficient of the y’s. 

Let 1 denote the length of the interval of integration 6 — a. Then the 
area under the graph of (3) is 


( 5 ) 


X i/» ^i/s 

ydx — I (flo -f- a,® 02 ®== -f Oj®» o,®‘ Oj®' 

I/» •/-!/» 


Oa®® -j- a^x' -j- OsO^) dx 


■ Ool-f ^ 4. f£. . 

12 ~ 80 ^ 448 ^ 


Osi* 

2304’ 


To find yo, Vi, y-i, etc., we put ® — 0, ®„ — ®„ etc. in (3) and get 


yo— «o 

yi + y-x — 2 (flo -f a.ii* -f atXi* + dsXj* -f aj®,®) 
yj + y-3 — 2 (Oo -f 02®.* + 04 ®*® -}- aa® 2 « -f Os®.®) 
etc. 

Substituting into (4) these values of the y’s, we obtain 

(G) A — i[9ao -f 2a.(®,* ®j* + 4- ®4*) 2a^{xi* -f ®j* -f ®,* -f Xt*) 

+ 2 a,(®,® + ® 2 « -f ®,« -f ®,«) 4 - 2 oa(®,« 4 - ® 2 « 4 - ®a® 4 - z/)]. 




The solution of the system (?) u sot easy, but the reader can easily 
verify that the four equations are satisfied hj the Talues 

Xi — 00839511, Xt— 0 2643811, Xt — 0 3005091, x« — 0455795J 

Hence the u’s for f»«-9 above are Ux—tjl, «,-~X|/I, etc 
Tchebychefi’s formula m terms of the ^s directly it thus, for n * 9 

(8) -l-l/9(y. + y.+y.,+y.+y-. + s». + y^ + y. + y-.), 

wheR the y't mutt be lueaetmd at the aubdituton poiuta of the inteml 
of integration 


Because of the fact that the functional values all have equal veight (the 
same coefficient) in TchebjchefiTa formula, this formula u particularly 
appropriate for use when the functional values are found by measurement, 
for in that case the positive and negative errors of measurement vDl largely 
cancel one another TchebycbeS’s formula would be ideal for findmg areas 
from drawings if it were not for the fact that the points of division are not 
readily located Even so, these points can probably be located with an 
accuracy equal to that of the drawing 
Example Compute by Tchebyche&’a formula the value of the integral 

S for ft — 6 

Solution. Here we must express x m terms of u as in the two precedmg 
examples We have 

„7„ + 85, 
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<^(«o) = ^ = 0.117647 

“ 7(0.187271) + 8.5 “ 9.810897 
“ 7(— 0.187271) +8.5 “ 7.189103 “ 

“ 7(0.416249) +8.5 11.413743 0-08^614 

“ 7(— 0.416249) + 8.5 "" 6.586257 "" 

[ence 

7 

— y (0.117647 + 0.101927 + 0.139099 + 0.087614 + 0.179011) 

= 0.875417. 

'he error in this result is 0.000051. 

67. Euler’s Formula of Summation and Quadrature. The approxi- 
late relation between integrals and sums is expressed by Euler’s summa- 
ion formula. Written as a quadrature formula it is * 

[itei+/(».) +/te) +. • .+/(*.„) 

^ irm ~rm + ^ [rm -rwi 

■“30840 + 13(^600 t^**!*) —/'“(<•)] ] 

hS. 

y adding and subtracting h[f(za)/2+f(x„)/2] on the right-hand side 
. (1) we have 

f. • •+/<=i)]— I [fW +/(!„)] 

■ ■■ 
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Transposing and dividing throngh by h, we get 

/(*.) +/(».) + +/(^-) - i +/(»•)] 

+^[f(i)-rw]-|^[r'(s)-rw]+ . 

or, since Xo — a, Xi, — h. 


2 /( 1 .) 

( 2 ) 


- iX 1[«“> +/(»)]+^[r(i)-/'(«)] 


720 ^ 




Fomnla (2) is Ettlti't ttimmatwn formuh It is useful for finding 
the approximate sum of any number of consecutive values of a function 
wbeu these values are given for equidistant values of x, provided the 
integral f*f(x)dx can be easily evaluated In these formulas h is the 
distance between the equidutant values of x, so that nh — h — a 

Note Formulas (t) and (2) differ in an important respect from the 
quadratore formulas previously derived In (1) the terms on the right* 
hand side, heginningwith (A/12)(/'(h) — /'( a)], form an asymptotic senes 
The same is true of (2), begianiiig with the term {b/lZ)lf{i) —/'(«)] 

An asymptotic senes is an infinite senes which converges for a certain 
number of terms and then begins to diverge In computing with such a 
senes it is important to know what term to stop with in order to get the 
most accurate result W« should atop not with the smallest term hut with 
the term just before the smallest, for the error committed u usually less 
than twice the first neglected term • and is therefore least when the first 
term neglected is the smallest term in the senes For the reason just given 
it IS important that Euler’s formula be used with caution, especially when 
finding sums by (2) We shall now apply each of these formulas to an 
example 

Example 1 Compute the value of a- from the formula 



See Cbarlier, loe ciL, p 14 
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Solution. "We take ft = J and compute the values of y = 1/(1 -j- 
at each point of subdivision, as shown in the table below. 


X 


X 

y 

0 

1 


0.69230769 


0.97297297 


0.59016393 

A 

0.9 

1 

0.5 


0.8 




We next compute the derivatives of 1/(1 -f x'), as given below. 

24g(l — X-) 

‘ ^ (l+x")" ’ 

-]T +iy [w*=-3*‘-a]. 

(1°+°?). - «!* + 49i=- 7]. 

Bence 


f(0)=0, f(l)=-i 

r(o)=o, r(i)=o, 
/"(o)*=o, r(i)=i5, 

/^(0)*=0, fH(l)=0. 


Substituting all these values in (1), -we get 

~ — [0.75 4- 0.97297297 + 0.9 + 0.8 -f- 0.69230769 + 0.69016393] 

SexiS^ 2) V anoitn O-^SSSOSie, 

■which is correct to its last figure. 

Example S. pind the sum of 
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Solution Here /(*)•— I/** and A — 2 Then 


rw — 




Remembering that b — 51, 6 — 99, and substituting m (2), we get 


- 1 f" ^4. ir^+^n +i.r— - —1 

bJm 2Ul*^99*J^ sUl* 99'J 

-±r± --Li+iir-i— i-1 

15 Lei* 99*J^2 iL61* 99U 

_6ir_L_i_i 

ISLSI* 99»J 


— 0 001753416 + 0 0002432490 

+ 0 0000021694 — 00000000008 

— 0 004998833 

If we had attempted to find the sum of the squares ef the reciprocals 
of all the odd numbers from I to 99 we could not hare obtained it accurately, 
for each bracketed quantity after the second would hare been practically 
unity and therefore the rarious tcnns »ou!d hare been the same as the 
coefficients 4/15, 16/21, 64/15, etc To get the greatest accuracy in this 
case we should hare to stop with the third term and even then the enor 
might be neatly 8/15 Hence the necessi^ for caution in finduig sums 
by means of Euler’s formula 


58 Caution In the Use of Quadrature Formulas. The student ehould 
ever bear m mind that when computing the value of a definite integral by 
means of a quadrature formula be is really replacing the given integrand 
by a polynomial and integrating this polynomial oter the given interval of 
integration The accuracy of the result will depend upon how well the 
polynomial represents the integrand over this interval, or, geometrically, 
on how well the graph of the polynomial coincides with the graph of the 
integrand Before bcgicnmg the computation of an integral by a quadra 
ture formula the computer should ascertain the nature and behavior of the 
integrand over the interval of integration In som'* instances it may be 
necessary to construct an accurate graph of the integrand. The compute 
tion can then be planned with reference to the nature and behavior of the 
function to be integrated The following example will illustrate this point 


Example 1 


Find by Simpson’s Rule the value of the integral 


I 


“j; 


— x’dz 

(2 — *)•»/' 
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Solution. The integrand is evidentlj- negative from s = — 1 to z == 0, 
and positive from z = 0 to z == 1. Hence we divide each of these intervals 
into four equal parts and compute the value of the integrand at each point 
of subdivision. The results are given in the table below. 


X 

V 

X 

y 

-1 

0 

0.25 

0.000001555 

-0.75 

-0.0001231 

0.50 

0.000485 

-0.50 

-0.00001753 

0.75 

0.02070 

-0.25 

-0.000000304 

1 

0 

0 

0 




On appl 3 ’ing Simpson’s Rule to these tabular values we find 

— 0.0000441, 

7^,1 = 0.006981, 

. 7 == — 0.0000441 -f- 0.006981 = 0.006937. 

This result could be accepted with confidence if the tabular values were 
of the same order of magnitude, but the table shows that the integrand 
at X ■= 0.50 is enormously larger than it is for smaller values of z, and 
that at z = 0.75 it is enormously larger than at z == O.oO. Hence we had 
better examine this function more closely in the region from z == 0.50 to 
1 = 1 and possibly make a new computation of the integral. 


X 

y 

X 

y 

0.50 

0.0004S5 

0.80 

0.038468 

0.55 

0.001136 

0.82 

0.048654 

0.60 

0.002514 

0.84 

0.061016 

0.65 

0.005297 

0.86 

0.075765 

0.70 

0.010688 

0.83 

0.092918 

0.75 

0.020701 

0.90 

0.11221 

O.SO 

0.038468 

0.92 

0.13259 



0.94 

0.15149 



0.96 

0.16306 



0.9S 

0.15190 



1 

0 
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The above table shows the variation of the integrand in the interval 
0 50 ^ X ^ 1, and Fig 4 shows the graph for the whole interval from 
X — — ltox»*l A glance at the graph shows that in order to obtam 


Y 



a trustworthy result we should divide the computation into three distinct 
parts 

{ I") By talciDg h — 0 S5 in ttie interval — 1 < x < 0 5, 

(2) By talcing h — 0 05 in the interval 0 5 < i < 0 8, 

(3) By taking A — 0 02 m the interval 0 8 < x < 1 
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The results of these computations are 

J®;® = — 0.0000031, 

I = 0.002898, 
j 1^ = 0.020651, 

I = — 0.0000031 + 0.002898 + 0.020651 = 0.0235. 

' Even when the graph of the integrand is a smooth, regular curve in 
the interval of integration, a quadrature formula may not give a very 
accurate result unless the subdivisions are very small. This fact is illus- 
trated by the following example. 

Example 2. Find by Simpson’s Rule the value of 
/ = J’ V(l— 2^)(2 — a;)£ix. 

Solution. The values of the integrand are given in the table below. 


X 

y 

X 

y 

-1 

0 

0.1 

1.371496 

-0.9 

0.742294 

0.2 

1.314534 

-0.8 

1.003992 

0.3 

1.243756 

-0.7 

1.173456 

0.4 

1.169310 

-0.6 

1.289961 

0.5 

1.060660 

-0.5 

1.369307 

0.6 

0.946573 

-0.4 

1.419859 

0.7 

0.814248 

-0.3 

1.446720 

0.8 

0.657267 

-0.2 

1.453272 

0.9 

0.457165 

-0.1 

1.441874 

1 

0 

0 

1.414214 




The correct value of the given integral to five significant figures is found 
from a table of elliptic integrals to be 

I — 2 . 2033 . 

Simpson’s Rule gives the following values for different values of h : 

(a) I »= 2.0914 for /i = 0.5. Percentage error ==5.1%. 

(b) / = 2.1751 for A = 0.2. Percentage error = 1.28%. 

(c) I = 2.1934 for h = 0.1. Percentage error = 0.42%. 
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It will be observed that when the interval of integration was divided 
into 20 submtervals the error waa nearly a half of one per cent, which u 
less than slide rule accuracy Inasmuch as the tabular values are all 
correct to six or seven figures, the errors m the results found above are 
due entirely to the inherent inaccuracy of Simpson’s Eule The trouble 
with this problem lies in the fact that the integrand cannot be approxi 
mated closely by a polynomial near the end points of the range of Integra 
tion, for at these points the slope of the integrand is infinite A better 
approximation can be obtained by nsmg horizontal parabolas for the regions 
near the ends of the interval (see Note 2 on p 142) Thus, for the region 
at the left end of the interval, we have 

_ (2/3) (02X 1 003992) — 0 1338656 , 
and for the region at the right end we have 

7, — (2/3){0 2X0 657267) — 0 0876356 
Then the application of Simpson’s Hole to the region from — 0 8 to 
ar — 0 8 gives 

/» — 1 9780924 

The sum of these is 

+ — 21996, 

the percentage error of which is 0 17 per cent 
In Art 62 several formulas will be derived for the inherent error in 
Simpeon’s Buie, but occasionally a problem may arise when the approximte 
error cannot be easily determined even with the aid of those formulas 

59 Uechanical Cubature In this article we shall give two methods 
for finding the numerical value of a definite double integral of a function 
cf two independent variables The first method will be by application of a 
formula which may be regarded as an extension of Simpson’s Bole to 
functions of two variables The second method is simply by repeated 
app’ication of the ordinary quadrature formulas for one variable 
To derive the double quadrature formula we start with the formula for 
double interpolation, namely (X) of Art 46, and integrate this formula over 
two mtervals in the y direction and two m the x direction, first omittmg 
from the formula all terms mvolviug the differences A**', A**’, A**®, A**‘, 
A**’, A®’*, siscs these AiSsTsacea zantlre rsJues ot the iasctioa outside the 
rectangle over which we are integrating 
Since dx — hdu, dy — kdv we have, after omitting the terms just 
mentioned. 
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/ „ zdydx = lih ^ J' | ^oo + + vA°*%o 

^ 1 |;u(u — 1) AS'Ozoo + 2 iiui^"*" 2 oo + v{v — 1) ^®*"zot>3 
-f — [3u(« — l)vA**‘zoo + 3uv(v — l)A^*%o] 

+ — l)v(u — l)A=*®Zoo] l^vdu. 


PerfomiBg the indicated integrations and replacing the double differences 
by their values as given in Art. 45, we get 

( 1 ) I •= [ZoO “ 1 “ 2o2 ■{" 2;2 -j- Zjo -J" 4 (Zoi -}- 2 j2 ■{■ ^21 -j- 2 io) -f IfiZiiJ. 

This is the formula whicn corresponds 'io Simpson’s Kule for a function 
of one variable. It can be represented diagramatically as shown in Eig. 5, 
the coefficients of the several z’s being shown on the diagram. By adding 
any number of unit blocks of this type we could obtain a general formula 
for double integration, corresponding to Simpson’s Eule for n intervals in 
single integration, but it is not worth while to do this. 

Formula (1) can be rewritten in either of the following forms: 

(2) /=. g (2 oO+42oi+Zo 2)+4;' — (Zjo+4Zii-|'2l2)~j- ^(2 o2+4Zis-}-22!)]> 

(3) f '“’■g j^^(2oO-f-4Zn)4'22o)-}'4‘^(Zoi+4Zii-}-Z2l)+ g (Zo2~l-4Zl2+Z2r)]- 


Now, such an expression as (fc/3) (zo^ + ^z^o 4" Zto) is nothing but Simpson’s 
Eule applied to a single row in the diagram, in this case the top horizontal 
row. Let us put 

h it 

■^0 "“^{zoo + 4 r,o + Z20), “g- (zov + 42 ^ 4* z-i), etc. 

Then (3) becomes 

(^) "g ('lo 4“ 4Ai 4“ A2). 

This formula shows that formula (1) is equivalent to applying Simpson’s 
Eule to each horizontal row in the diagram and then applying it again 
to the results thus obtained. These considerations lead to the followino’ 
general statement: ° 
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If we are ffiien a recian^iihtr array of talufj of a function of two 
vartdbles, we may apply io each hortzonla! row or to each terhcal column 
any quadrature formula employing equidistant ordinates. Such as Simpson's 
and Weddle's formulas Then to the results thus obtained for the rows 
(or columru) we may again apply a similar formula 



This important result makes it uDnecessary to derive general formulas 
for approximate double integration 

It IS instructive to notice the geometric significance of this general 
statement Since the double integral between constant limits of a func 
tion of two variables is represented by the volume of a solid having a 
rectangular base and a height at any point equal to it is 

evident that the integrals Ao, A^, etc are merely vertical cross sectional 
arc^ of this solid made by equidistant planes Then when we apply a 
quadrature formula to these yl’s we are merely finding the volume of the 
solid as if ue evaluated the integral j^A^x 
An engineering application of mechanical cubature would be the solution 
of such a problem as the following 




MECHANICAL CUBATURE 
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Suppose it were necessary to determine the amount of earth to be moved 
in making an excavation for a large building on uneven ground, or in 
grading down or filling in a city block. The area to be excavated would 
be divided up into small rectangles by running two systems of equidistant 
parallel lines at right angles to each other. The distances of the corners 
of'these rectangles above or below an asumed datum plane would be the z’s 
of this article. Knowing these s's and the distances between the parallel 
lines (the k’s and Fs), we could find the volume of the excavation by the 
methods given above. 

We shall now work two examples by these methods. 

Example 1. Find by formula (1) the value of the integral 



Solution. Taking h = 0.2 and k == 0.3, we compute the values of c = J /xp 
shown in the table below. 


X 

1 4.0 

4.2 

1 4.4 

2.0 

0.125000 

0.119048 

i 0.113636 

2.3 

0.10S696 

0.103520 

0.09SS142 

2,6 

0.096154 

0.0915751 

0.0874126 


Substituting these in (1), we get 

j _ [0.12500 4- 0.096154 + 0.0S74126 + 0.113636 

4- 4(0.108696 + 0.0915761 + 0.0988142 
+ 0.119048) 4 16 X 0.103520] 

^ 0.0250070. 

Tlie true value of the integral is 


rx 


*•« dydX' 


= In 1.1 X In 1.3 

■ 0.0953108 X 0.262364 
' 0.0250061. 


The error is tt.erefore 

E 0.0250061 — 0.0250070 = — 0.0000009. 
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Example S Find by numerical integration the value of the integral 



Solulion Here \re take A — 02, 1 — 03 as before, and compute the 
following table of values of * — l/*y 



200 I2S000 
2 3 0 I0S696 
2 6 0 006154 
2 9 0 0862069 
320 07812S 


4 2 


0 110048 
0 103520 
0 0915751 
0 OS2101S 
0 0744048 


0 113636 
0 0983142 
0 0374126 
0 0783699 
0 0710227 


0 108696 
0 0945180 
0 0836120 
0 074962« 
0 0679348 


0 104167 
0 0905797 
0 0301282 
0 0718391 
0 0651042 


0 100000 
0 0869565 
0 0769231 
0 0689655 
0 0625000 


5 2 


0 096154 
0 0836120 
0 0739645 
0 0663130 
0 0600962 


Applying Weddle’s Rule to each honxonlal row, we have 
A, — 0 06[0 125000 + 5(0 119048) + 0 113636 + 6(0 108696) 

+ 0 104167 + 6(0 lOOOOO) +0096154] 

— 0131182, 

Ai — 0114072, At — 0100909, A, — 0 090470, 

A< — 0 081989 

Kow applying Simpson’s Rule to the A’s, we get 
/ — 0 1[0 131182 + 4(0 114072) + 2(0 100909) 

+ 4(0 090470) + 0 081989 — 0123316 

The true value of this integral is 

St * X" 13XJnl6“0 123321, 

and the error is therefore 

— 0 123321 ~ 0 123316 — 0 000005 

80 Pnsmo'i&s and tiie Trismoidal TormulA. The lifrmula to he con- 
sidered in this article is a special form of Simpson’s Buie and the oldest 
form of that rule It is treated here because of its importance and wide 
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applicability in- the mensuration of solids. The formula -Hdll he derived 
vrith reference to a solid. 

A prismoid may be defined as a solid whose bases are polygons in parallel 
planes and whose lateral faces are ruled surfaces, either plane or warped. 

If we let one base of the prismoid lie in the yz-plane and let the lateral 
faces extend in the general direction of the positive i-axis, the volume 
of the prismoid will be given by the integral 

V= (A{x)dx, 

where A[x) denotes the area of a cross section parallel to the bases and 
at a distance x from the yz-plane. To find A (a:), let 

( 1 ) y’=ax-\-l 

( 2 ) z = cx-\-d 

be the equations (in projection form) of any moving straight line. Such 
a line can move in any manner and will generate a ruled surface as it 
moves along. In a plane parallel to the yz-plane and distant x to the 
right of it the area of the cross section of the prismoid is given by the 
integral 

A(x) = fy dz, 

the integration being extended over the entire cross section. 

Now, in the fixed plane under consideration a: is a constant, and y and 
z are functions only of the parameters a, b,c,d; that is, in this plane 
y and z can vary only when and as the parameters vary. Let each of these 
parameters be a function of a single parameter a. Then y and z become 
functions of a, and from (2) we have 

dz ^ (cx -f d)da = (c'x d')da. 


The integral giving the area of the cross section now becomes 
A (x) = y dr = (ax + b) (c'x + d’) da 

«=.x== r ac'da + x f ‘^bc' + ad') da fbd'da, 

“o Oo J do 

where it is assumed that the entire cross section is covered when a varies 
from ato to Oi. Since each side of the cross-sectional polygon is a section 
of a different ruled surface, the integrands above will change (be replaced 
bj others) as the different sides of the polygon are encountered.* Also, 

The integral giving A (a-) in this problem is really a line integral See E B 
Wlson-a Adronerf Cc.tculus, p. 289, or Goursat-Hedrick, Mathematical AnalyciB, 

V Ou If pp, loi •iou* ' 
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Since the above integrals jd the eapressjon for A (i) are independent of z, 
they may be denoted by p, q, r, respectively Hence we have the important 
result that 

(3) A(x)-~‘px*-^qx + r, 

which shows that the area of the cross section of a prismoid is a quadratic 
function of its distance from one base and tlierefote from either cf its bases 
To find the volume of a prismoid of length I, we take coordinate axes 
with the yz plane coinciding with the midsection of the solid Then 

X i/t /• i/» 

J (pi’4-9T+r)dj — + 

l>et Bi and £> denote the areas of the bases of the prismoid and let 3f 
denote the area of the midsection Then from (3), 

Hence 

+ fi, — ^ + 2r ^ + 2Jlf, from which 

Substituting in (4) the values of p and r just found, we get 

m F— j(B. + B, + 43/), 

which is the Pnsmoidal Formula The reader should keep in mind the 
verbal statement of this formula oamely The volume of a pnsmotd w 
equal io one sixth ike product of tts length by the sum of xls bases and 
four times its midsection 

It IS io be noted that the pnsmoidal formula gives the exact volume 
not only of the prismoid but also of any other solid in which the area of 
the cross section is a quadratic function of the distance of the cross section 
from one base Such solids are cones, pyramids, spheres, spherical seg- 
ments, frustums of cones and pyramids, vredges, paraboloids of revolution, 
jini uitihff sui’fdf <i/ li aiar grreir wnfft tfppnMiKMA.'iflr 

the volumes of barrels and casks 

Hote Some writers use the ferns prismoid and pnsmatoid inter 
changeably, as if both terms referred to the same solid Such is not the 
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case, however. A prismatoid is usually defined as a polyhedron (a solid 
with plane faces)) having for bases two polygons in parallel planes and 
for lateral faces triangles or trapezoids with one side common with one 
base and the opposite vertex or side common with the other base. The 
volume of a prismatoid is found by decomposing the solid into pyramids 
having their vertices at a point in the midsection. The volume of a pris- 
matoid is given by the prismoidal formula because the area of the cross 
section of a pyramid made by a plane parallel to its base is proportional 
to the square of the distance from the section to the vertex (or base) of 
the pyramid; that is, the area of the section is a quadratic function of its 
distance from the base. 

The prismoidal formula is the fundamental formula for computing the 
volume of earth in cuts and fills for railroads, highways, canals, etc. The 
cross-sectional areas of cuts (or fills) are determined at convenient intervals 
(100 feet apart or less) and then the volume of earth to be excavated 
(or filled in) is computed by the prismoidal formula. 

Example. A proposed railroad cut 100 feet long is represented approxi- 
mately to scale in Fig. 6. Compute the number of cubic yards of material 
to be excavated. 


E 



Ita. 6 
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Solution The areas of the bases ted midsectiOQ are found by subtracting 
the areas of the tvo tnaaglea from the area of a trapezoid in each case 
Hence 

B. - 51 — 1 (8 X «) — 1 (14 X 21) - 366 iq It, 

B. _ 45 — 1(6X9) — }(12X18)-270iqa, 

JI — 48(10)— 150 — 330Bq It, 

and therefore 

F — ^ (36S + 270 + 4 X 330) — 32,600 cn ft. — 1207 4 cu. yd. 

D 

When the pnsmnidal formula is used to find the Tolnme of a aolid in 
vhicb the cross-aectional area does not vary as the sqnare or enbe of the 
distance of the eeclioa from one base, the error committed u the same as 
that in Simpsons Role (see Art 62) 


szEBaSRs yni 

1 In the table beloir are giren corresponding ralnes of a rtnable z 
and an unlcnoim function y For what ralue of 7 is y a minimum? 


• 9 


3 -205 

A -240 

5 -259 

« -282 

7 -250 

8 -224 


2 For what ralue of s is the foIlowiDg tabulated function a minim um? 
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3. In the year 1918 the declination of the snn at Greenwich mean noon 
on certain dates was as given below. Find when the declination was a 
maximum. 


Date 1 

Declination 

June 19 i 

23“ 

25' 

23'’ 

.5 

// 

20 

tt 

26 

19 

.4 

« 

21 

It 

26 

50 

.5 

/I 

22 

II 

26 

56 

.8 

It 

23 

f< 

26 

38 

.3 

II 

24 

II 

25 

55 

.1 

II 

25 

It 

1 

24 

47 

.1 


4. Compute the value of 


I 



V 1 — 0.162 sin® <f> d<j3 


by Simpson’s Eule and by Weddle’s Eule, taking 

<#.==0°, 15°, 30°, 45°, 60°, 76°, 90°. 

Compare your results with that found by the series method in Exercise 
25, Chapter I. Also compare the amount of labor involved in each case. 

X I dx 

by Gauss’s method, taking n «= 5. 


e. Compute by Simpson’s Eule the value of the integral 


I 



dx 

logic s ’ 


taking eight subintervals. 


7. Find by Weddle’s Eule the value of the integral 


/ 


xdx 

J C.4 sinh I ’ 


taking twelve subintcrvals. 
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8 Find by Euler’s quadrature formula the value of the integral 
7 — ^ cosx*(fr 

and compare the result with that found bj integrating the series for cos** 
9. Find by Euler’s summation formula the sum of 

400 ^ 402 ^ ^ 498 ^ 500 

10 Find the lalue of the integral 

^ ~ J* fofiie 


by Simpson’s Rule, taking ten submterrals 

11. Compute by any method the value of the integral 

/•'/* 

7—1 Vcosfidff 


12 


13. 


Compute to five decimal places the value of 

I- 

eos* 

Using the data of the following table, compute the integrals 


(a) ^ xy dx, 


(d) J ^y'df 


by S!mp«on’8 Rule 

* I 05 I 06 I 07 I 08 I 09 [ 10 I 11 
V I 04804 j 0 6669 [06490 j 07262 j 0 7935 [ 08658 | 0928r 


'N 
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THE ACCURACY OF QUADRATURE FORMULAS 

61. Introduction. A computer should have some means of estimating 
the reliabilit}' of every computed result. It is not always possible to have 
an explicit formula giving the error committed, but usually there exists 
some means for ascertaining the magnitude of the majority of unavoidable 
errors. In the present chapter we consider the accuracy of the more im- 
portant quadrature formulas and give expressions for the inherent errors in 
several of them.* 

62. Formulas for the Inherent Error in. Simpson’s Rule, (a.) The 
General Formula. Let f{x) denote a function which is finite and con- 
tinuous in the interval x = Xo — h to x = Xo h and has continuous 
derivatives of all orders up to and including the fourth in that interval. 
Furthermore, let F{x) denote the integral of f{x), so that 

F{x)^ j'Jfix)dx, F'{x)^f{x), r'{x)=f(x), eto. 

Then 

f{x)dx = F{xo h) — F{xo — h). 

The value of this integral by Simpson’s Rule is 

The difference between these results is the inherent error in Simpson’s Rule, 
so that 

(1) F(xo 4- h)—Fix,—h)- ~ if(xo — h) Af{xo) 

+ f(x, + k)l 

This formula is of no practical value as it stands, because it is indefinite 
and cumbersome. It can be reduced to a simple and workable form in 
cither of two ways. 

• A method for comparing the relative accuracj- of quadrature formulas em- 
ploying equidistant ordinates will be found in the following literature: 

1. “On the Relative Aecuracy of Simpson’s Rules and Weddle’s Rule,” Amcncan 
ifctlimatical ifonihly, Vol. XXXIV, No. 3 (March, 1927), pp. 135-139. 

2. The first edition of this book, pp. 153-155. 

ISl 
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1 The expression for Eg is clearly a function of h Hence, following 
the method of Vall6e Poussm, we denote it by 4>{h) and write 

Differentiating both sides successively with respect to h, we have 

♦'(M -/(». + i) + /(*.-!) -y m 

- 1 [/(*. + *)+■•/(».)+/<*.- i) ], 

-/'(I. + i) -f (1.-1) -A tr'K + ») +r(*.~»)] 

*"'(*) — j [r"(*. + ») -r(».- M) 

By the theorem of mean value this last expression in brackets is equal to 
wkere — A<|<x* + A Hence 

(2) ♦"(») 

On putting k — 0 in the expre<sions for ♦(A), we find that 

We now integrate (2) three tunes with respect to h, either by integrating 
from 0 to A or by determining the constant of integration at each step 
In either case we make use of the relations 4{h) —0, —0, and 

4"{h) 0 for ft — 0 Although the factor f’{f) depends to some extent 

on the magnitude of the interval (0, ft), we can replace it by its mean value 
m the interval and remove it from under the integral sign Assuming that 
this IS done at each step, we have 

*'■'(*) /■•«), 

♦"(») — 

^■^W 
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Since this 4y{h) is the inherent error for an interval of -svidth 2h, the 
inherent error for a subinterval of width h is half this ataount, or 

Then since b — a*=»nA, we have as the inherent error for the whole 
interval b — a: 

( 82 . 1 ) a - » (- 

where ^ now lies between a and 6, or a < ^ < 6. 

2. Another way of simplifying (1) is by means of Taylor’s theorem. 
Expanding F{xo-j-h) and F(xo — h) by Taylor’s theorem and remem- 
bering that F'(xo) ’=-f{xo), F"(xo) =-f(so), etc., we have 

F(Xo + F(Xc) -f hf(Xo) -f y f(xo) -f y f'(Xo) -f--' 

F(xc~-h)^F(xo)-hf(xo) -hYr(^o)-^rM +• • • 

Also, 

fix, -f M + hfix,) 4- y f'ixo) + ^ r'M + • • • 

/(xo - M fi^o) - hf'(xo) -f y r(x.) - r (xo) 4- • • . 

On substituting in (1) these values for ^’(Xo 4- ^),F(xo — h), /(x, 4- ft), 
and /(xo — ft), we get 

%• * 
— ^ [/‘'’(xo) 4-- • ]. 

Hence the inherent error for the whole interval b — a is 

(3) Eb _ L lfy(x,) 4- fy(x3) .4- • • . 4- /■‘'’(x„_i)] — ■ . . . 

Let fiy(xrr) denote the gi-eatest value of any of the n/2 quantities within 
the braclvct. Then 


(62.2) 


Es^- 


nft* 

180 




180 


The values found for Es show that £’8 = 0 when f^ix) =0, Henre 

when /(x) is a polynomial of the first, second, or third degree, Simpson’s 
Rule gives tlie exact value of lix)dx. ‘Simpson s 
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(6) A Forviula tn Terms of Differences In many applications of 
Simpson’s Rule the analytical fonn of the function to be integrated is 
either totally unknown or else is of such a nature that its fourth deriva 
tire 18 dilTcuIt to calculate In either case formula (3) can not be applied 
as it stands We get around the difficulty by transforming it into another 
form 

Let us replace the den\ntives > etc by their ralues 

in terms of differences For this purpose we write Stirling’s interpolation 
formula in the form 

y - j. + « — y - + ^ 4 V- 

I u(u* — 1*) A»yt » + A»yt ;> 

■•■si 2 

to fourth differences 

Differentiating this formula with respect to sr by means of the formula 
dy/di— (dy/du) (du/di) and the relation i ik + hu, or u — (r — lk)/h| 
and then putting u — 0 in each derirative, we get 



Now putting k — x, Xt, Xn i, writing A*y«, »» — A*y ,, etc , and sab 
stituting in (3) these values of the fourth derivatives, we g^t 

(4) e, |5(4-y. + 4‘y. + 4‘».+ +i‘y..) 

This expression for the error in Simpson’s Rule is identical with the 
third set of terms in our central difference quadrature formula (53 1) 
That formula is therefore Simpson’s Rule plus its correction terms, as was 
stated on page 146 

(c) A Formula tn Terms of the Owen Ordxnates To get a formula 
for Ea in terms of the given ordinates, we replace the differences in (4) 
by their values in terms of the j^s as given in Art 16, Table 3 Since 
A*y I ^ yj“4y, + 6yi— 4y, + y „ 

A*yi — y» — 4y, + 6y, — 4y, + y„ 


A‘y» ) — y»,i — 4y, 6yi, i — 4y, j + y» i, 
we have, on substituting these in (4), 
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(5) Es = — ^ [y-i •+■ y"*! — "^(yo+yn) + ''(yi4-yn-i) 

— 8(t/: + y4 + ‘ • •+yn- 2 ) + 8(y3 + ys + * ■ ■4-y»-s)] 

when n ^ 6. 

If the number of subintervals be less than six^ the formulas for Es are 


(6) i?s- — ^[y-i +y3 — 4 (yo + y.O +6yi], for n = 2. 

(7) — ^[y-i + ys — 4(yo + y4) +7(yx + 2/3) — 8t/.], for n = 4. 


The ordinates i/-i and which are outside the interval of integration, 
can be found in one or more ways. If the values of y are computed from 
a formula and the formula holds outside the interval of integration, then 
we merely compute y., and from this formula by substituting the 
proper values of x. But if we are given only a tabular set of y's we find 
y.j and yn.i by extrapolation, the former by using Newton’s formula (I) 
and the latter by using Newton’s formula (II). 

(d) A Formula in Terms of Two Computed Results. Suppose two 
computations of a definite integral are made by Simpson’s Rule, using a 
difTerent value of h for each computation. Let i?i, hi, Ei denote the 
result, the value of h, and the error in the first computation, and let R^, 
hi, Ez denote the corresponding quantities in the second computation. 
Then by (62.1) or (62.2) we have 


Hence if ft- 


Ei hi* ’ 


or El == 


— , we liave 

El == IGEi . 



Let 1 denote the true value of the given integral. Then for the two 
computations we have 

J Ri ~ 1 “ El ■=*= Ri 16.^2 , 

I^Bi^Ei. 

Snbmcting the upper equation from the lower and solving for Ei, we get 

(S) . Ei^ ^ - ^\ 

lo 

This formula tells us that if we compute the value of a definite integral 
by using a certain value for h and then compute it again by using twice 
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8S many subdivisions, the error of th« second result will be about l/15th 
of the difference of the two results 

(e) To Find the Value of h for a Shpulated Degree of Accuracy m the 
Result If we wish to know the value of h to obtain a result of stipulated 
accuracy, we substitute in (62 1) or (62 2) the allowable error E, the 
maiimum value of f''(x)y the value of i — a, ignore the negative sign, 
and solve for A 

In case cannot be found, assume a convenient value A, for A, 

find E, by (4) or (5), and use the relation-^ which 

m 

where Ep denotes the allowable error 
We shall now apply formulas (5) and (62 1} to the first example 
worked m Art SO 

Example Compute by means of (S) and (62 1) the error in the 
evaluation of /•*lai<fr by Simpson’s Buie 
Solution M « must first compute y , end y.., from the given function 
y •— In z For these we have 

yi — In 3 8 — 133500107, 
y..,— la 5 4 — 168639895 

The values of y from y^ to y. inclusive are given in the table on page 134 
Substituting these ys m (5), we get 

Et H [3 02140002 — 4(3 03495209) 

+ 7(3 04452244) —8(3 05022046) 

+ 8(1 52605630)] 

— OOOOOOOlo 

The true error was found in Art 52 to be OOOOOUOlo 

To compute the error by (62 1) or (€2 2) we first find /’(z) from 
the equation /(z) — In z We thus have 



Hence 

E, S ((^) “ “ 
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This is of the same order of magnitude as the actual error but greater than 
it, as it should he. ' 

Suppose we wished to know the value of Ti necessary to give the integral 
correct to ten decimal places. Since W'e have already found the error 
corresponding to a particular value of h, we can find the desired value 
by substituting in formula (9). Here 

111 ■=“ 0-2, Et. = 0.00000015, Ej, < 0.00000000005. 


Hence we have 


h < 0.2 


/0.000 00000005 \^ 
\ 0.00000015 / 


Since h — a = n/i, we find that we should have to divide the interval 
(4, 5.2) into more than 45 subintervals in order to get a result correct 
to ten decimal places. 


63. The Inherent Error in Weddle’s Rule. In deriving Weddle’s Rule, 


we omitted the quantity — omitted quantity is the principal 
part of the error inherent in the formula. In terms of derivatives it is 


140 




Hence 

(63.1) 


E^, 


140 


A'’y = - 


¥ 

140 


P\x). 


This means that when /(i) is a polynomial of the 5th degree or lower, 
Weddle’s Rule gives an exact result. 

64. The Remainder Terms in Central-Difference Formulas (53. 1) 
and (53.3). The remainder terms in these formulas can be found by 
integrating the remainder terms in Stirling’s and Bessel’s interpolation 
formulas from which (53.1) and (53.3) were derived. Since (53.1) is 
at least as accurate as (53.3), and since a more definite formula can be 
derived for the remainder term in the latter than in the former, we shall 
derive the remainder term for (53.3) only and use it for computing 
the error in both formulas. In Art. 40 we found the remainder term in 
Bessel’s formula (VI) to be 




( 2 « + 2 ) 




Since j{x)di is the quantity that is integrated by a quadrature formula. 
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it J3 plain that R^{x)dz is the qaantitj which must be integrated to find 
the inherent error m the quadrature, and since we hare for 

fhe error m a single submterral of width h 

liCt US put 

Then 

{2n + 2)' ' 

Thia 13 the error for a single subinterTal of width h Let Jf. denote 
fhe maxiaum value of m the intervaJ (tf, i) Then siBce there 

are {h — a)/h subintervats from t^a to x^b, we have for the total 
er-or m the interval (a, 6) 

From this general formula we get particular ones by assigning values 
to n Thus, if we include fourth differences in (S3 3) and neglect all 
higher diHerences, ae put n = 2 Then (2) becomes 

Ml- 

and therefore (3) becomes 


or, more simply. 

In terms of diffeiencia this becomes 


(5) 

where A‘y 


( 6 - 0 ). 

1 the largest of the sixth differences 
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If include sixth differences in (53.3) and neglect all higher differ- 
ences, then fi = 3 and (2) becomes 


On substituting these in (3) rre find 


or 

( 6 ) 


“ == 3628800 '' ’’ 


1453 

In terms of differences this becomes 




b ^ I (i — a) 

° ^ 1453 ’’ 


' 4 




dv 


2497 
° 180 


where A*!/ is the largest of the eighth differences in the interval (a, b). 

When we stop with fourth differences in formula (53. 1) or with third 
differences in (53.3), the error is to be computed by (6); and when we 
•stop with sixth differences in (53.1) or with fifth differences in (53.3), 
the error is to be compirted by (7). 


65. The Inherent Errors in the Formulas of Gauss, Lobatto, and 
Tchebycheff. The inherent errors in the formulas of Gauss, Lobatto, and 
Tchebycheff are usually given in terms of the coefficients in a power series. 
To find the error in any given case, it is therefore necessary to expand the 
function as a power series and pick out the appropriate coefficients, 
one or more. 

For Gauss’s formula tlie principal part of the inherent error is * 


( 1 ) 


b — a / n ! 

(2n -f 1 )-2='' Vl • 3 • 5 • • • (2;i — 1) 


N/ ^ r I (n -p l)(7l -f 2) 


where the L's are the coefficients in the power series 


n(n — 1) 
2n — 1 



(2) <?>(u) •= Zfo -f- LjU -f- L 2 U- -f- • • • L^nU-" 

When the scries for 6{u) is rapidly convergent, the term involving 
in formula (1) may be omitted. 

If the analytic form of ^(u) is not known, Eq cannot be determined. 


* Derived in Todhunlor’s Functions of Laplace, Lamf, and Bessel, p. lOS. 
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Example Find Eo for thf example in Art 54, p 165 
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Solution 


Here 
<^(u} — 


1 

l-u + S,, 


bincc 2« 2 — • 12 We must therefore find tin coefficients of 

u*® and u** in the series for ^(u) We hare 



From this series ire see that 


Substituting these in (1), we get 


■pX 


-mr 


11X2’ 11 3 5 7 2/ 

— 0 00000017 + 0 00000008 — 0 00000025 


This result agrees well with the actual error 0 00000028 found in Art 54 
There are no simple formulas in terms of n for the inherent enors in 
the formulas of Lobatto and Tchebycheff Formulas for particular values 
of n are given in the tables at the end of the booh by B P Moors 

66 The Remainder Term in Euler’s Formula tlalmsten’s expression 
for the remainder after m terms in Euler’s formula of summation and 
quadrature is 

(1) + 0<t!<l. 


for a single subinterval of width h 

Let If denote the numerically greatest value of in the whole 

interval (a b) Then for the n subintervals we have 

(2) R„gfw4,«A»"*W, 

or since n— (5 — <i)/h, 

(3) «> 


Here A,m has the following values 
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A; 


_ 1 _ . 

12 ’ 



30240’ 

1 

47900160 ■ 


1209600’ 


IMorc useful, perhaps, than formula (3) is the following working rule 
due to Charlier : 

In stopping with any term in Euler’s formula the error committed is less 
than twice the first neglected term. 

Hence we get the most accurate result by stopping with the term just 
before the smallest, so that the first neglected term is the smallest of all. 


We shall now show that the first two terms of Euler’s formula will give 
a more accurate result than Simpson’s Eule. 

Putting 7?2'=2 in formula (3), we have 


R,:^A,h<M{h-a)^^{h-a), . 

■where M denotes the greatest numerical value of f"{x) in the interval 
{a,b). 

The remainder term in Simpson’s Buie is (Art. 62) 




h*M 

180 


ih-a). 


Hence the inherent error in Euler’s formula for only two terms is just 
one fourth that in Simpson’s Eule. 


EXERCISES IX 

1. Compute the inherent errors in the answers to Exercise 4 of Chapter 
VIII and compare these errors •with that found in Exercise 25 of Chapter I. 

2. Compute the inherent error in the answer to Exercise 6 of 
Chapter VIII. 

3. Estimate the accuracy of the answer to Exercise 8, Ch. VIII. 


Mechanik dcs HimncU. II, pp. 13-16. 



CHAPTEH X 


THE SOLUTION OF NUMERICAL ALGEBRAIC AND 
TRANSCENDENTAL EQUATIONS 
t EQUATIONS IH ONE UKENOWN 

67 Introduction It is shown in algebra how to sohe literal equations 
of all degrees up to and including the fourth, and it is also shown how 
to compute the roots of namencal equations of any degree Algebra is 
silent however, on the solution of such types of equations as ax-\’l\ogx 
==•0 ae ' -f & z 5, etc These are 'ranscentfenfal e ^uattons, and no 
general method exists for finding their roots in terms of their coefficients 
When the coefficients of such equations arc pare numbers, however, it is 
always possible to compute the roots to any desired degree of accuracy 

The object of the present chapter is to set forth the most useful methods 
for finding the roots of any equation having numer cal coefficients Since 
Homer’s method is explained in most college algebras, and since it can not 
be applied to transcendental equations, we shall not consider it here 

68 Finding Approximate Values of the Roots. In finding the real 
roots of a numerical equation by any method except that of GraeSe, it is 
necessary first to find an approximate value of the root from a graph or 
otherwise Let 

(1) /(x)-0 

denote the equation whose roots are to be found Then if we take a set 
of rectangular coordinate axes and plot the graph of 

(2) y “/(*>- 

it IS evident that the abscissas of the points where the graph crosses the 
X axis are the real roots of the given equation, for at these points y is zero 
and therefore (1) is satisfied Approximate values for the real roots of 
any numerical equation can therefore be found from the graph of the 
given equation It is not necessary however, to draw the complete graph 
Onlj the portions in the neighborhood of the points where it crosses the 
X axis are needed 

Eien more useful and important than a graph is the following funds 
mental theorem 

If f(x) ts continuous from x — a to z — b and xf f(a) and f(b) have 
opposite stpns then there ts at least one real root between a and b 
This theorem is evident from an inspection of Fig 7, for if /(a) and 
192 
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f(b) have opposite signs the graph must cross the a:-axis at least once 
between i = a and x = 6. 


Y 



In most cases the approximate values of the real roots of / (x) — 0 are 
most easilj' found by writing the equation in the form 

( 3 ) h{x)=Mx) 

and then plotting on the same axes the two equations 

= y2 = /2(®)- 

The abscissas of the points of intersection of these two curves are the real 
roots of the given equation, for at these points t/i — and therefore 
fj{x) ^f:{x). Hence (3) is satisfied and consequently f{x) == 0 is like- 
wise satisfied. 

We shall now apply the foregoing methods to two examples. 


Example 1. Find approximate values for the real roots of 

X logic X == 1.2. 

Soluiion. We write the equation in the form f{x)—x\og^oX — 1.2, 
assign positive integral values to x, and compute the corresponding values 
of f{x), as shown in the table below. Since /(2) and f(3) have opposite 
signs, a root lies between x = 2 and x == 3, and this is the only real root. 

^ I ^ i 2 i 3 [4 '' 

/(x) j — 1.2 J —0.6 I +0.23 j 0-1.21 

The approximate value of the roots can also be found by writing the 
equation in the form 


X 
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and then plotting the graphs of yi and y* — 1 The abscissa 

of the point of intersection of these graphs is the desired root 
Example 2 Find the approtimate xalue of the root of 
3r — cosar — 1 »= 0 


y 


SoluUon Since this equation is the difference of two functions, we an 
write it in the form 

3i — J — cosz 


Then we plot separately on the same set of axes the two equations 
y, — 3z — 1 

The abscissa of the point of intersection of the graphs of these equations 
13 seen to be about 0 6 (Fig 8) 


Y 



Of course we could also find this approiimate value by computing a table 
of values of the function /(i) — 3z — cosz — 1 and noting the change in 
sign of /(*), as m Ex 1 


4r 


69 The Method of Interpolation, or of False Position (Regula Falsi) 
he oldest method for computing the real roots of a numerical equation is 
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the method of false position, or "regula falsi.’^ In this method we find 
two numbers Xi and between which the root lies. These numbers should 
be as close together as possible. Since the root lies between Xi and X2 the 
graph of must cross the z-axis between x = xi and z = Z2, and 

y, and y; must have opposite signs. 

Now since any portion of a smooth curve is practically straight for a 
short distance, it is legitimate to assume that the change in f{x) is pro- 
portional to the change in x over a short interval, as in the case of linear 
interpolation from logarithmic and trigonometric tables. The method of 
false position is based on this principle, for it assumes that the graph of 
y'=/(z) is a straight line between the points (ii, yi) and (arj, y^), these 
points being on opposite sides of the z-axis. 

To derive a formula for computing the root, let Fig. 9 represent a magni- 



fied view of that part of the graph between (zi,yi) and (z2,y2). Then 
from the similar triangles PMS and PRQ we have 


RQ h X2 — Xi 

MP-RP’ °"|yx|“TlMTm- 
(1) lyi.i, 

I yi 1 + 1 ys 1 

The value of the desired root, under the assumptions made, is / 


Hence 

( 2 ) 


■= 2^1 MS = Zj -}- A. 


ly>l. 

i yi i + 1 y: I 


This value of z is not, however, the true value of the root, because the 
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graph of y = f{x) is not a perfectly straight line between the points P and 
P It IS merely a closer approximation to the true root 

I ' In the practical application of the regula falsi method we compute a short 
table of corresponding values of x and /(*) for equidistant values of x— 
units, tenths, hundredths, etc Then by means of (1) we compute cor 
rections to be applied to the previously obtained approximate values The 
following examples should make the method clear 

Example I Compute the real root of 

rlogitx — 1 2 — 0 


correct to five decimal places 


Soluhon 

The short table in Example 1 of the preceding article shows 

that the root lies between 2 and 3 and that it is nearer 3 Hence we make 
out the following table and then compute the corrections by (1) 

Ist 

X 

y 


2 

— 0$ 

0 83 

approx 

8 

+ 0 23 

x(») -,2 + 0 72 — 2 72 y 

Diff 

1 

0 83 

Snd 

27 

— 004 

approx. 

28 

+ 0 05 

- 2 74 J 

01 

0 09 

3id 

approx 

2 74 

2 75 

— 0 0006 
+ 0 0081 

j 001 X00006_^„„ 

0 0087 

0 01 

0 0087 

— 2 74 + 0 0007 — 2 7407 

4th 

approx. 

2 7406 

— 0 000039 

. 0 0001 X 0 000039 

2 7407 

+ 0 00004i> 

* 0 000084 

0 0001 

0 000084 

— 0 000046 Jj 


x(‘)— 2 7406 + 0 000046 
— 2 74065 


Remark In examples of this kind it is necessary to use logarithms to 
more decimal places with each snoceeding approximation In this example 
eix place logarithms were used in the last approximation 

Example £ Find the real root of the equation 


Sx — cos X — 1—0 
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Solution. In I2x. 2 of the preceding article we found the apjiroximate 
value of this root to be 0.6. Hence we begin by computing the following 
short table of corresponding values of x and f{x) = 3a: — cos a: — 1—y. 

It is evident from the table that the root lies between 0.60 and 0.61. 
Hence we proceed with the first appro.ximation by the regula falsi method. 


X 

fix) 


0.60 

-0.025 


0.6i 

4-0.010 

« 

0.62 

-fO.046 



X 

y 


1st 

0.60 

— 0.025 

, 0.01 X 0.025 

/l \ **' ~ ^ ■ ' 

approx. ! 

0.61 

+ 0.010 

' 0.035 

Diit. 1 

0.01 , 

0.035 

= 0.60 -f 0.0071 = 

2nd 

approx. 

0.607 

— 0.00036 

, 0.001 X 0.00036 

t\,*i ~ — ' 

0.608 

+ 0.00321 

0.00357 

0.001 

0.00357 

= 0.000101. 

=0.6071. 

3rd 

approx. 

0.6071 

0.00000 

ha = 0. 

0.6072 

0.00035 

a;<=) =0.60710. 

0.0001 

0.00035 



70. Solution by Repeated Plotting on a Larger Scale, The following 
method is the graphical equivalent of the regula falsi method and has the 
.advantage of giving a visual representation of the approximating process. 

Suppose an appro.vimate value of the root has been found from a graph 
or otherwise. Plot on a large scale a small part of the graph of y = f(x) 
for values of x near the desired root, so that one can see more clearly about 
where the graph cro.->ses the x-axis. An additional figure of the root can 
be read from this graph. Then plot on a still larger scale a small part 
of the graph for values of x near the improved value of the root (the value 
just found), and continue the process in this manner until the root has 
been found to as many figures as desired. The following example should 
make the method clear. 

Exaviplr. Find the positive real root of 


r — cos 


^ O.TSi 


54 — orVl — : 




1 — 21 * 
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Solufion We first compute the Tslne of the left memher for several 
values of x, as given m table (1) This table shows that a root lies 
between 0 5 and 0 6 Hence we plot the graph of the given equation from 
x»>05toz>-*06 and assume it to be a straight line within this interval 
The result is Fig 10 (a), and it shows at a glance that the root is about 
0 56 or 0 57 We therefore compote table (2) and plot the results as 




Ta 10 
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shown in Fig. 10 (b). This graph shows that the root is about 0.579 
Continuing the process in this manner by computing tables (3) and (4) 
and plotting the results on still larger scales as shown in Figs. 10 (c) 
and 10 (d), we find the desired root to be a: = 0.67936 to five figures. 

This method and the regula falsi method are particularly valuable for 
finding the roots of complicated equations such as the one solved above. 


71. The Newton-Raphson Method. When the derivative of f{x) is a 
simple expression and easily found, the real roots of f{x)=0 can be 
computed rapjdly by a qjroce’ss called the Newton-Eaphson method. The 
underlying ideS of the method is due to ]Sre\vton, but the method as now 
used is due to Eaphson.* 

To derive a formula for computing real roots by this method let a 
denote an approximate value of the desired root, and let h denote the 
correction which must be applied to a to give the exact value of the root, 
so that 

x = a-\-h. 


The equation f(x) ■=» 0 then becomes 


f{a + h) =0. 


Expanding this by Taylor’s theorem, we have 


Hence 


/(o -\-h) — f(a) 4- + ■ 5 " 0 = ^ 1 . 

4 ^ 

/(a) + ma) + Y r(a + Oh) = 0. ^ 


Now if h is relatively small, we may neglect the term containing 
and get the simple relation 


from which 
( 1 ) 


/(a) + Af(a) = 0, 

m 






f(a) 




The improved value of the root is then 


( 2 ) 


flj = a -L hj *= a ■ 


Ka) 


m' 


♦ 5;, 


uec Cajon's Bistory of MathemaUcs, p, 203. 
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The succeeding approximations are 


/(g.) 

/(g.)’ 


f(<h) 


/(g. .) 

/(«- .) 


Equation (1) is the fandamcntal formula in the Newton Eaphson pro- 
cc«s It IS cMilont from this formula that the larger the denratire f(x) 
the smaller is the correction which must be applied to get the correct 
value of the root This means that when the graph is ’nearly vertical 
whole it cro ^ca the r avis the correct lalue of the root can be found with 
great rapidiU and \er\ little labor If on the other hand the numerical 
\alue of the deri\atne /'(x) should be small in the neighborhood of the root 
the \alues of ) gnen b\ (1) ivould be ta^ and the computation of the 
root by this method would be a slow process or might even fail altogether 
The Newton Raphson method should never be used when the graph of 
/(i) IS nearly horizontal where it crosses the r axis The process will 
evidently fail if / (x) — 0 in the neighborhood of the root In such cases 
the reguU falsi method should be used 
We shall now apply the Newton Raphson method to two examples 


Example I 


Compute to four decimal places the teal root of 


**+ ismx— 0 


vy 


Solulton Since the term t * is positive for all real values of x, it is 
evident that the equation will be satisfied only by a negative value of z 
We find from a graph that an approximate value of the root is —19 
Since /{z) — z’ -t- 4 sin z and / (z) — 2z + 4co3Z we have from (1) 


(— 1 9)* + 4 sin (—19) 3 61 — 3 78 

2(— 19) + 4co3(— 19) “ —38 — 1293 


(— l93)*-|-4Bin(— 193) _ —00198 

2(— 1 93) + 4 cos (— 1 93) — 6 266 

0 0038 

q, 19338 


This result is correct to its last figure, as will be shown later 
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Example 2. Find by tbe Newton-Eaphson method the real root of 

Zx — cos a: — 1 = 0. ^ 

Solulion, Here 

f{x) = 3x — cos a: — 1, 
f(x) = 3 + sin X. 

We found graphically (Fig. 8) that the approximate value of the root is 
0.61. Hence 

3(0.61) —cos(0.61) —1 0.010 

3 + sin(0.61) “ 3.57' 

= — 0.00290. 

.‘. a, = 0.61 — 0.0029 =0.6071. 

, 3(0.6071) —cos(0.6071) —1 

- 3 4- sin (0.6071) 

= 0.00000381. 

.•. fl; = 0.60710381. 

This result also is true to its last figure. / 

It will be observed that the root was obtained to a liigher degree of 
accuracy and with less labor by this method than by the regula falsi 
method. 

72. Geometric Significance of the Newton-Raphson Method. The regula 
falsi method assumes that the graph of the given function is replaced by 
the chord joining (ii, jfi) and (s-, jia). No such geometric assumption 
was made in deriving the formula for computing the roots by the Newton- 
Raphson method, but the formula has a simple geometric significance 
nevertheless. 

Let Fig. 11 represent a magnified view of the graph of y = f{x) where 
it crosses the i-axis. Suppose we draw a tangent from the point P whose 
abscissa is a. This tangent will intersect the s-axis in some point T. 
Then let us draw another tangent from Pi whose abscissa is OT. This 
tangent will meet the i-axis in some point Ti between T and S. Then 
we may draw a third tangent from P^ whose abscissa is OTi, this tangent 
cutting tile z-axis at a point between Ti and S, and so on. It is 
evident intuitionally that if the curvature of the graph does not change 
sign between P and S the points T,Tx,Tz,- • • will approach the point 
S as a limit; that is, the intercepts OT, OTi, OT., • • • will approach the 
intercept OS as a limit. But OS represents the real toot of the equation 
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whose graph is drawn Hrace the quantities OT,OT„OT„ are 
successive approximations to the desired root This is the geometnc 
significance of the Newton Raphson process 


Y 



To deme the fundamental formula from this figure let JlfT — An 
TTi — A, etc The slope of the graph at P is f'(o) But from the figure 
we have 


FJlf — f(a) and slope at F — tan Z \ Tp 


M 

“ A, 


which is the fundamental formula of the Newton Raphson method From 
the triangle PiTTi we find in exactly the same way 


h ^ 


/(g) 

/(«) 


From the preceding discussion it is evident that m the Newton Raphson 
method the graph of the given fnnction is replaced by a tangent at each 
successive step m the approximation process 
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The New-ton-Eaphson method should not be used when either f(x) = 0 
or f"(x) = 0 near the desired root. Use the method of enlarged graphs 
(Art. 70) in such cases. 

73. The Inherent Error in the Newton-Raphson Method. If a is an 
approximate value of a root of / (x) = 0 and h is the necessary correction, 
so that f(a-\-7i) =0, tlien we have by Art. 71 

(1 ) f(a) + hfia) -f Y /"(? I- eh) = 0, 0 < d < 1. ^ ■ 

In the Kewton-Eaphson method we neglected the term involving li- and 
got an approximate value from the equation 

(2) /(a) + /i.f(a)==0. 


Subtracting (2) from (1), we have 


(h-h,)f'(a)+jna + eh) = 0. 


( 3 ) 


h — III — — h- 


r(a + eh) 

Zfia) 




Now since h is the true value of the required correction and hi is its 
approximate value, it is plain that k — hi is the error in hi. The error in 
hi is thus given by (3). Let M denote the maximum value of f"{x) in 
the neighborhood of a -f- Then 


(4) 


mo)- 


Our next problem is to express this error in terms of the known quantity hi. 
Clearing (4) of fractions and transposing, we have 

Mh'‘ + 2f (a)7i = 2f'ia)hi. - 


• -r(") -f V[r(«)]^ + 2Mf'{a)hi 

Now expanding the quantity [l + 23/A,/f(a)]H by the binomial theorem 
wo have 
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-^(-/W + n«)+m.-2 7^ + J xm?) 


Hence 

(5) 


■ 2f(a) 2[f(a)]» 


Error — A - 


A 4. 

-*■ — 57(5 + 


2F(«)]- 


y 


Since hi is always a small decimal, it is evident that the pnacipal part 
of the error is contained in the first term on the right hand side cf (5), 
so that we may neglect the term involTing A,* The formula for the error 
thns reduces to 

(0) E,s|^| . 

This la the error in a, The error m n. is therefore 


( 7 ) 




VK* \ / 

■^1577551 

Now in most equations which one would solve by the Newton Bsphsoa 
method the quantity Jlf/2/'(a) u not greater than 1 Suppose, therefore, 
that j 3f/S/ (a, i)| £ 1 Then (7) reduces to 


( 8 ) 




This result is most important, for it tells us that if A, begins with m 
zeros when expressed as a decimal fraction, then A.* begins with 2m zeros 
This means that when the first significant figure in A is less than 7, we 
may safely carry the division of /(o..,)//'(a,.,) to 2m decimal places, for 
the error in the quotient will be less than half a unit m the 2mth decimal 
place Stated otherwise, the number of reliable vgnxficant figures tn h « 
equal to the number of zeros between the decimal point and first significant 
j^qure, ■provided the number of reliable figures in both /(a, ,) and /'(a»-i) 
13 as great as the number of zeros preceding the first significant figure m A 

Hence iti finding the correction h from the relation A— — 4 ^-t, the 

IW 

divisions of f{a) by / (a) should be carried out to only one more significant 
figure than the number of zeros between the decimal point and first 
significant figure 

We thus have a simple method for determining the accuracy of the roots 
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found by the Newton-Raphson method, and this fact makes this method 
much superior to the regula falsi method when the root is desired to 
several decimal places. 

It is now clear why we were able to say in Exs. 1 and 2 of Art. 71 that 
the results obtained were true to the last figure in each case. 

74. A Special Procedure for Algebraic Equations. Many algebraic 
equations can be solved by first removing some of the known real roots 
by synthetic' division and then solving the resulting depressed equation 
by the easiest method available. For example, if the depressed equation 
is a quadratic, it can always be solved by the quadratic formula. The 
following example illustrates the method, 

Exaviple. Find all the roots of 

X* — 26x- + 493; — 25 = 0 

Solution. Since the graph of y — — SGr- + 493: — 25 crosses 

the y-axis at (0,-25), it is plain that the given equation has at least 
two real roots. By assigning integral values to x and computing the 
corresponding values of f(x), we find that these roots are near — 6 and 4, 
respectively. They arc found more accurately by the Newton-Eaphson 
method to be — 5.916 and 3.876. Now removing these roots from the 
given equation by synthetic division, we have 

1 0 —26 49 —25 

— 5.916 34.999 —53.238 25.072 (—5.916 

1 —5.916 8.999 —4.238 (3.876 

3.876 —7.907 4.233 

1 — 2.040 1.092 

Neglecting the remainder terms in each division, we have 
i= — 2.040x-}- 1.092 = 0 

for the depressed equation. Solving this by the quadratic formula, we get 

X = 1.020 ±: 0.227i 

as the remaining roots. As a check on the computation, we have 

Sum of roots = 0.000, ^ 

Product of roots = — 25.038, 
which is a satisfactory check. 
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It IS sometimes <]esirab]e to knov (he nature of the roots of a cubic or 
quartic equation before attempting to find them For a thorough discussion 
of the nature of the roots of lhe«e equatjons see Burj)«jde and Pantos s 
Throrg vf Lquatium \ol I 

75 The Method of Iteratfon When a numerical equation /(j)— 0 
can be espressed in the form 

(1) ar-^(r), 

the real roots can be found by (he proceea of tleralwn Thi* la tbe method 
which was used for inverse interpolation in Art 34 The proccs* is this 
^^e find from a graph or otherwise an approximate value a, of the duired 
root Me then substitute this in the right hand member of (1) and get 
a heiter approximation x'** given by the equation 

Then the succeeding approximations are 

») ✓ 

We ahalf apply the process to t«o examples 

Example 1 Find by the method of iteration a real toot of 

2* — log,, X — 7 

5ofufton The given equation can be vritten in the form 

M e find from the intersection of tbe graphs y, — 2 j — 7 and y, — logu * 
that an approximate value of the root u 3 8 Hence ve have 
xO) -.-}(log38 + 7) — 379, 

— i(l<«3 79 + 7) — 3 7893, , 

x‘‘> — |(li^3 7893 + 7) — 3 7893 

Since *<•) IS the same as ^e do not repeat tbe process but take 3 7893 
js the cDTXfnt xesnJi to ^ve J^njea. Tie jfexsfjrm /irncess Js the shortest 
and easiest method for working tins example 
Example £ The method of iteration is especially useful for finding 
the real roots of an equation given in the form of an infinite series To 
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find an expressidn for tlie probable error (see Art. 155) of a single 
measurement of a set^ one procedure is to find the real root of the following 
equation (see page 480) : 


or 

(a) 




1320 


+ . . . = 0.4431135, 


fi 



216 1320 


0.4431135. 


We shall now find the value of p to six decimal places. 

Solution. Neglecting all powers of p higher than the first, we find an 
appro.{imate value of p to be 0.44. Hence we start with this value and 
substitute it in the right-hand member of (a). The result is 


(0.44)’ (0.44)’ (0.44)’ 

(0.44)® 

, (0.44)“ 

^ 3 10 42 

216 

1320 

= 0.4699 = 0.47, say. 



Then the second approximation is 



(0.47)’ (0.47)’ , (0.47)’ 

(0.47)® 

(0.47)“ 

” 3 10 42 

216 

1320 


= 0.47554 «= 0.476, say. 


4- 0.4431 


-f 0.44311 


Writing (a) in the form 

P = <#>(p)> 

we find the succeeding approximations to be 

pW =<p{0A7b) =0.4767, 
p«) =<^(0.4767) = 0.47689, 

= <^(0.47689) = 0.476927, 
p(=) (0.476927) =0.476934, 

p(‘) = ^(0.476934) = 0.476936. 


This last value is correct to its last figure.* 

The reader will observe that the iteration process converges slowly in 
this example. This is due to the nature of the given equation. In Ex. 1 the 
convergence was rapid. 


Xoie. Usually there arc two or more ways in which an equation f(x) = 0 
can be written in the form x = ^(x). It is not a matter of indifference 
as to which way it is written before starting the iteration process, for in 

* The value of p correct to ten decimal places is 0.47C9362762. 
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ICwf X 


some fonns the process will not conveige at all An esample of this u 
given m Art 81 


76 Geometrj of the Iteration Process. It is instructive to look tt 
the geometric picture of the iteration process For simplicity we denote 
the successive approximations to the root by xt,x„x,,x,, ,x» Then 

the relations 

*1 — <J(X4) 

Xi— + «tc. 

can be pictured as paints by the following geometric construction 

Draw the graphs of y, — a and y» — ^(x), as shown in Figure 12 Since 
^'(x)| < 1 for comergence, the inclination of the curve y>*— ^(x) smst 
he less than 45^ in the neighborhood of x^ This fact has been observed in 
constructing the graph 
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Now to trace the convergence of the iteration process, draw the ordinate 
<^(xo). Then from the point Po draw a line parallel to OX until it inter- 
sects the line t/, = x at the point C,[x„ (#>(a;o)]. Note that this point Qi 
is the geometric representation of the first iteration equation x, = ^ (xo) . 
Then draw QiPi, PjQz, QiP:, PiQs, etc., as indicated by the arrows in tlie 
figure. The points Qi, (?;, Qa • • • thus approach the point of intersection 
of the curves yi=x and y- == ^(x) as the iteration proceeds. Note that 
the coordinates of these Q’s satisfy the corresponding iteration equations. 

The reader should draw a curve — if)(x) with inclination greater than 
45° in the neighborhood of Xo and then proceed w’ith the construction as 
outlined above. He will find that the points Qi, Q 2 , etc. recede farther and 
farther away from the intersection point of the graphs and that the succes- 
sive approximations i,, X;, etc. get worse as the iteration proceeds. 

77. Convergence of the Iteration Process. We shall now determine 
the condition under which the iteration process converges. The true value 
of the root satisfies the equation 

x = .^(x), 

and the first approximation satisfies 

x(^)=^(xo). 

Subtracting this equation from the preceding, we have 
a: — =Kj>{x) — <#>(xo). 

By the theorem of mean value the right-hand member of (1) can be 
written ' 

,^(x) = (x— Xo)</.'(|o), X. 

Hence (1) becomes 

x~xW = (x — Xo)<^'(^„). 

A similBt equation holds for all succeeding approximations, so that 
X_I<3) _ (x — 


x~x<^) = (x — X 
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lliiltipljing together nil the<e equations, member bj member, and dividing 
the result through by the common factors x — a — x — i'* », 

we get 

(2) X — — (x — 


Noh if the maximum absolute Talue of 4'(x) is less than 1 throughout the 
inter\al (x«,i), so that each of the quantities etc is not 

greater than a proper fraction m, we get from (8) 


(3) 


I X — !<•> 1 ^ |x — x« I 


Since the right hand member of (3) approaches sero as n becomes large, 
we can maVe the error t — x'** as small as ne please by repeating the 
iteration process a sufficient number of times 
The condition, then, for convergence is that ] ^'(x) | be less than 1 in the 
neighborhood of the de'ired root the smaller the mine of ^'(x) the more 
rapid the convergcmc Thi' londition ua' lati'fied in Examples 1 and 
2 of Art 75 


J 


78. CoDvergesco of the Kewten'IlaphseD Uethod. 
Raphson formula 


( 1 ) 


•w. 


' no 


shows that the Newton Baphson method is really an iteration method; 
and since (1) can be written symbolically in tbe form 


0-.1 — *(0-), 

»— ^(y), 

we see at once from Art 77 that the Newton-Raphson method converges 
when 

Hence from (1) we have 


dx\ A*)/^ {r(«-)]‘ 


The suflScient condition for convergence is therefore 

\ Hono \ 
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01 

(2) i/(fl7.)r(an)}<Cf(an)]*. 

79. Errors in the Roots due to Errors in the Coefficients and Con* 
stant Term- If the coefficients and constant term in an equation are 
rounded mimbers and therefore correct to only a certain number of digits, 
the computed roots will be affected by errors due to the inaccuracy of the 
coefficients and constant term. We now consider such errors in algebraic 
equations and in transcendental equations. 

a) Aigeiraic Equations. Assume that the q’s in the equation 

(1 ) /(^) + ■ * ' "I” = 0 

arc subject to the errors LOa, Aa^, Aq;, ■ • * > Afln- Then each root will be 
subject to an error Ax. 

If the exact values of the a’s ate Aao,fli + AUj, Oj -{- Aa*, • • • , 
a„ -j- AOn and the exact value of any root is i -f Ax, then by (1) : 

(ffo + AOo)(x -f Ax)" -f («i -f Aai)(x -f Ax)"-^ + (ffi 4- Aaj)(x + Ax)"'* 

■h ■ * ■ “h 4“ Afln-»)(® 4* Ax) On 4* Afl,j = 0. 

Expanding the powers of i -f Ax and neglecting all terms containing 
products, squares, and higher powers of the errors, we have 

(2) CoX" -j- OiX"'* 4- a-x"-* + • • • -f- a„_jX 4- a„ 4- naoa^"‘^Ax -f x"Aflo 

4- Cj(7i — l)x"'*Ax 4* x"'*Aa^ 4" ® 2 (R — 2)x"'*Ax 4* x"'*Afl 2 4" ‘ ‘ ‘ 
4- o^iAx 4- xAa^i 4- Ao„ = 0. 


Subtracting (1) from (2), we have 

(3) [floTix"'* 4- Oj(n — l)x"-*4-a;(n — 2)x"-*4-' • •4-a„_3]Ax 

<= — (x"Aao 4- 2:"'*Ao, 4- x^-^'Ac* 4- ' ' • 4" 4- Ao„). 

Hence 

(4) Ax (x"Aao 4- x"'^Aai 4~ x”~-Aa- 4~ ' ' ~ 4~ 4~ AAq) 

floflX"'' 4- — l)x"'* 4* U:(n — 2)x"'* 4" ■ ■ ■ 4" fln-i 

(x'-ACo 4- x"-*Aaj 4- x"-*AO: 4* ' ‘ ' 4- xAa„_, 4- Aa„) 

m 

The maximum numerical value of Ax is obtained by taking the maximum 
nnnvcTical value of the numerator of (4). Since the signs of the errors 
AtiiHAS],- • • An„ are not known, we may give these errors such signs as 
will make all terms in the numerator positive. Then we have 
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[ i»Aa, i 4- [ a* »Aa, I + i g*-*Aat | + +1 | + 1 Aa. | 

‘^= I /■(,)! 

If 1 } represents the greatest numerical value that any of the errors Aoo, ia, 
etc can hare, then 

(6) Az^ 

The numerator of (6) can be simplified by means of the remainder 
theorem of algebra That theorem ahovs that the function z*‘— 1 u 
exactly divisible by x — 1, so that 

+ +Z + 1 



Applying thia result to the numerator of (6), we get 


This formula gives an upper bound for the error in each root of (1) when 
the appropriate value of x is substituted therein 
It 18 vO be noted that (3) is merely the differential of (1) when the 
d’s and X are all treated as variables 


Example In the equation 

I* — 1 842**— 3 740z + 1 357 — 0 

the coefficients and constant term are rounded numbers and correct to three 
decimal places The roots to three decimal places are 
1,-0 321, r, — — 1432, z, — 2 953 
The upper bound of the error id each root is required 
Soluhcfl Here the value of ij is 0 0005, and 


Then by (7) 


/(*) — 3z>— 3 684r — 3 740 

i± 3ny-i 0 000158 

‘= 0321 — 1 461 

X ^-000048 

~ 1432 — 1 ^ 769 
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Hence the root.? may be taken to be 

.j'l = 0.321, X2 = — 1.432, oTs == 2.95. 

b) Transcendptifiil Equaiions. As fornnila (1) does not apply to trans- 
cendental equations, such equations must be investigated individually. Hor 
e.vaniple, if in the equation 
(8) aln.r -f &sina- = c 

a. b, c, and x are all subject to error, vre find by differentiation 


/?'!• 

a }- In xda b cos xdx -j- sin xdb = dc, 

X 


from which 


dx ■■ 


dc — In xda — sin xdb 


X 


5 cos a; 


If q is the upper limit of the errors dn, db, dc, we have 

, , _ 1 I In X 1 -4- I sin X 1 

(9) dx< ^ ^ 

— b 0 cos X 

X 

Example. If m (8) 0 = 3.21, i = — 0.35, c = 1.57 and these are 
rounded numbers correct to the number of decimals given, and x = 1,813, 
let us find dx. 


Sohtiion. Since 0.005, we have by (9) 

( 1 + 0 - 5950 + 0 : 9708 ) 0 . 005 , _ 

g. v.vv.v, 

— — 0.35 X0.2398 

Other transcendental equations can be treated in the same manner. 

11. SIMULTANEOUS EQUATIONS IN SEVERAL UNKNOWNS 

The real roots of simultaneous algebraic and transcendental equations in 
several unknowns can be found either by the Newton-Eaphson method or 
by the method of iteration. IVe shall give an outline of each method for 
the cases of two unknowns and three unknowns. The reader will have no 
difficulty in extending both methods to the case of any number of unknowns 
should the necessity arise for doing so. 

80. The Newton-Raphson Method for Simultaneous Equations. Let 
us consider first the case of two equations in two unknowns. Let the given 
equations be 
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(1) 0, 

( 2 ) 0 

Kot if z», yt b« Approximate valaea of a pair of roota and h,ki)t correctioni, 
so that 

y— 

then (1) and (2) become 

(3) ♦(x, + A,y,+ i)-0, 

(4) ^(i, + A,y,+ ]r) -0 

Expanding (3) and (4) by Taylor*a theorem for a function of two Tsriables, 
we haxe 

(5) + *,>. + !:)- + k + ‘ (I). 

-f- terms in higher powers of K and A*— 0 

(6) (K«. + »,». + ‘) -*(*..».) + * (i), + ‘ (^), 

+ terms in higher powers of K and A -* 0 
Now since k and k are relatirely smaU, we neglect their squares, prodoets. 
and higher powers, and then (5) and (€) become simply 

(8) 

Sohing these by detennmants, we find the first corrections to be 


(I), 


/a^\ 



Anr. SO] 
where 
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( 11 ) 



/3<^\ 

\dx/o \^y Jo 
/3^\ 

\dx)o \3y/o 


Additional corrections can be found by repeated applications of these 
formulas with the improved values of x and y substituted at each step. 

The notation {d<i>/dx)o means the value of d4>/dx when Xa and j/o a™ 
substituted for x and y. Similarly, (3^/0.r)i means the value of d<i>/dx 
when X x*'*, y = y''* ; and so on. 

In the case of three equations in three unknowns. 


<#>(2;,y,2) “0, 

^(x,y,z) f=0, 
x{x,y,z) — 0, 


let h, k, I, denote corrections to the approximate values x^, yo, Zo, respec- 
tively. Then proceeding exactly as in the case of two equations, we, get 
the three simple equations 


Vo, Zo) + h (II) + ^ (^) + ^ (If) “ 

-^( 2 = 0 , yo, Zo) 4- h (II) + fe (||) + 1 (^) ~ 0, 

x(^o> Vo, Zo) + h ( 1 ) + fc (^) + I (^) - 0, 


for determining the first corrections hi, hi, I,. The process may be repeated 
as many times as desired. 

We sball now apply this method to a pair of simultaneous equatioiu, 
one transc'endental and the other algebraic. 

, Example. Compute by the Newton-Eaphson method a real solution of 
the equations 

C X 3 logio X — y® — 0, 

|2x* — xy — 5x -f- 1 — 0. 

Soluiion. On plotting the graphs of these equations on the same set 
of axes, we find that they intersect at the points (1.4, — 1.5) and (3.4, 2.2), 

We sball compute the second set of values correct to iour decimal places, 
IjcI 

( 1 ) 


y) '^X -h 3 logjoX — y*. 



( 2 ) 

Then 


SOLUTIOV OF NUMERICAt EQUATIONS 
f{ar,y) — 2i* — ly — 5i + 1 


- — • 1 wliere 0 43429, 


Now since z* — ■ 3 4, y« » 2 2, w« hwe 

*(*e y.) — « 1545, ^{a:o.y.) — — 072, 

(&).-“ ( 1 ).—^^- 

a*).— 

SaUUtutiog these vsluee in (9), (10), (II), we find 
A, <-0157, A. — 0 085 

Hence 

*t«i_34 + 015r — 3 657, y"* — 2 285 

Now substituting £<“ and y*” for x and y m i^(z,y), ^(z,y)> 
etc , we get 

^(*'”,y<”) OOU, ♦(x<'>,y")) —03945, 

(^)r— » 

Substituting these in (II), (9), (10), we get 

A, 00685, A, — — 0 0229 

*(»)_3 4885, y‘*» — 2 2621 

i these improred values of x and y wo 


Hence 


Bepeatmg the computation i 
find 
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Hence the third approximations are 

x<‘i ^ 3.47R8, --== 2.26154, 

and these are correct to the last figure. 

81. The Method of Iteration for Simultaneous Equations. In the case 
of two equations 

<f>(x,t/) =-0, 

we first write the given equations in the forms 

y~Fj(a;,y). 

Then if Xo, yo be the approximate values of a pair of roots, improvcil values 
are found by the steps indicated below : 


let i 

•“^'i(a:o,yo). 

approx. j 

yo); 

2nd 1 

(!<»>, yU)), 

approx. i 

[y(*)-=Fo(a:‘»), yU)); 


etc. 


If we are given three equations 

—O, 

•=• 0 , 

x(x, y, 2 ) •=■ 0, 

we would first write them in the forms 

y — if’i(a:,y,2), 

The successive steps in the computation would then be: 


x^^^ •^Fi{xo,yo,Zo), 


lEt 

approximation 



218 SOLUTION OF NUMERICAL EQUATIONS [Caif X 

o , fl»l — 

approiimation [*oi ,(«,,(.)) , 

etc 

We ehall nofr apol; the inteiatioa process to the pair of equations vhich 
we have alreadj vihed (for one pair of roots) h) the Newton Baphson 
method 

^ (*• y) — * + 3 logt# * — • y*> 

t]i(x,y) — 2z* — xy — 5x4* ^ 

golulton We start with the approximate ralnes Zg ~ 3 4, y, 2 2, as 
indicated by the intersection of the graphs In oar next step we are 
confronted with sereral possibilities, for the two equations can be writen 
in the forms Fi{x,y), y“*f’*(*.y) m seTcral ways In the absence 
of farther information we start oot with the simplest forms, namely 

* — y* — 31og,»i, 

y«>-4>2x»5 

Then we hare 


*(•1 _ (2 2)» — 3 logt, 3 4 — 3 25, 

>'‘'-3^+2(3 25)-5-1S1, 

*«*' — (1 81 )» — 3 log, .(3 25) — 1 74, 

+2(124) — 6-09! 

These ralnes of i and y are endeotJy getting worse with each application 
of the iteration process We most therefore write the given equations in 
some other form before attempting the iteration process again 
Without trying all possible forms we make a fresh start with the only 
forms that will make the process converge, namely 

^ Jr(y + 5)-l 

* 2 

y — Vx + 3 log,, * 


Then the successive approximations are 
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' 2 

yW ==. V3.426 3 logjo 3.426 = 2.243 ; 

r _ ^3.426(2.243 + 5)^ _ 3 


(*) ^ 

V 3.451 4- 3 log, 0 3.451 = 

x'®> >= 3.466, 

y(M 

= 2.255; 

2 ;( 4 ) 

== 3.475, 

yU) 

==2.258; 

X<'> 

= 3.480, 

y(») 

= 2.259; 

X<«> 

= 3.483, 

y(«) 

*== 2.260. 


Here it is evident that the iteration process converges very slowiy in this 
example, for after having applied the process six times we have added 
only one reliable figure to the approximate roots with which we started. 

This example brings out two important facts in connection with the 
method of iteration. The first is that we must not start out blindly in 
working a problem by this method, for instead of improving the roots at 
each step we might make them decidedly worse. The second important 
fact brought out is that the iteration process should not be applied at all 
in some examples, for the convergence might be too slow, as was the case 
above. All this leads us to a consideration of the conditions under which 
the process converges. Having these conditions at hand, we can decide 
in advance as to the advisability of attempting a problem by iteration. 

82. Convergence of the Iteration Process in the Case of Several 
Unknowns. To find the sufficient conditions for convergence in the case 
of two equations, we write them in the forms 

x = Fx(x,y), 

y‘^F2{x,y). 

These equations are satisfied by the exact values of the pair of rodls x, y. 
The first approximations satisfy the equations • 

x'^'> -=^Fi{xo,yo), 

^F4(lo,yo). 

Subtracting these equations, from the corresponding equations above, we 
have 


( 1 ) 


X — Fx(io,yo), 



(2) 


SOLUTION OF VUMERICAL EQUATION® 
y — y) — Ft (r„ y») 


Kov applying to the right hand aide of the first equation the theorem o{ 
mean value for a function of two variables, we have 


F,(*.,y,) — (i — T.) ^ +(! 
0f — J«).y«4-^(y — y )] 


and 


0x 


Zx 


0y ’ 


-JbR 


ZP, dP,[u + 0(x — T.) y.+ g(v- 
0y 3y 

In a similar manner we get 

F.(» »)-*’.(!. ,.) - ^ + (Sl-jr.) ^ 

Substituting these expressions for the right hand members of (1) and 
(2), we get 

*57 + (y-y«) -37 


5y ' 


y— y‘" — (*“ 


Adding these two equations and considering only the absolute valnes of 
the several quantities, we have 

(3) l*-«"’| + ly->"lai«-».l j|^| + |^|j 

+ ly-yi ilvl+lfli 

Now let the maximuin value of cither | 0Fi/3x | + 1 | or 

I ZF,/dy I + i 0r,/3y j be a proper fraction m for all points la the region 
(xo x) and (y<i,y) Then (3) becomes 

|i--x‘» I + ]y_y«> [<m{|sr — + |y— y.|} 

This relation holds for the first approximation For the succeeding 
approximations we have the similar relations 

I I-Il.l I + I y_,C.> I g „( I I + I I ), 

I I + I I S „( I I + I ,_y|.| I ). 

I I — I'"’ I + |y — ,1-1 |gm( 11 I + HI) 

Now multiplying together all these inequalities, member by member 
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and dividing through by the common factors { \ x — | + ] y — 

( jar — I + |y — y‘"’| }> etc., we get 

I I + j y — t/'"’ 1 ^ m"{ 1 x — Xo ) + ) y— yo 1 }- 

Since m is a proper fraction, it is clear that we can make the right- 
hand member of this inequality as small as we please by repeating the 
iteration process a sullicient number of times. This means that the errors 
lx — a:’"’ I and | y — y'"’ | can be made as small as we like. 

The iteration procc.ss for two unknowns therefore converges when the 
two conditions | dFi/dx | | dF~/dx \ < 1 and | dF^/dy | | dF^/dy j < 1 

hold for all points in the neighborhood of (ar,„yn). In order for the con- 
vergence to be ra|)id enough to make the method advi.sable in any given 
problem it i.s noee.s.sary that each of the quantities [ dFi/dx \ -{- j dFi/dx [ 
and I dFx/dy [ + j dF^/dy \ be much less than 1. 

We are now able to see why the convergence was so slow in the example 
which wc attempted to w'ork by the iteration process in Art. 81. For that 
example the values of the quantities naihed above arc 

I ?\P 

=0.52!+ 0.304 = 0.82.'5, 

^ +1^ =0.162 + 0 = 0.102. 

3y I 9y 

The first is much too large for rapid convergence. 

EXERCISES X 


1. Find graphically or otherwise the approximate value of a real root 
of the equation 


2x — Iog,oa:= 7. 


2. Find the approximate value of a real root of 

X sinh — — 16 = 0 

I 

3. Compute to four decimal places by the interpolation method the root 
found apiiroximately in Exercise 1 above. 

4. Do the same for the root found approximately in Exercise 2. 

5. Find to six decimal places by the Ncwton-Jlaphson method a real 


2x — 3 sin X — 5 = 0. 
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6 Sohe f >-0 21sia (0 5-^c) by the iteration process 
7. Find to three decimal places the smallest positire root of 
z* -{- 2r — 6 

B Find the smallest positire root of 

ztanz~128 

9 Find to five decimal placet a root of 

zlog,«z — — 0 125 

10 Find all the roots of 

3i* + 5* — 40 — 0 

11 Compute to six decimal places a root of 

66 — fi sinh 9 — 0 
12. Find the smallest root of 

z’ ^ z* z* 

13 Find a real solution of 

42** + 88y*— 142, 

{z — 12)*+(y — 06)*-l 

14 Find to fire decimal place* a solution of 

sinz — y — 1 32, 
cosy — z — 085 

15 Find all the roots of 

16 If a table of tangents for radian arguments is at Jiand, find two real 
roots of 

4z* + 12z* tan z* — 3 — 0 

Suggenlion Put — y, aolrc the resulting equati^ for y, and then 
find z 
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GRAEFFE’S ROOT-SQHARIHG METHOD FOR 
SOLVING ALGEBRAIC EQUATIONS 

83. Introduction. The methods given in the preceding chapter, except 
that of Art. '.d, are applicable only for finding the real roots of numerical 
equations. It is sometimes necessary to find also the complex roots of 
algebraic equations. In studying the stability of airplanes, for example, 
it is necessary to solve linear differential equations with constant coefficients. 
The solution of such a differential equation is effected, as' is well known, by 
first solving an algebraic equation whose degree is equal to the order of 
the given, differential equation. The algebraic equations which arise in 
stability theory are usually of the fourth, sixth, or eighth degree. A pair 
of complex roots indicates an oscillation, the real part of the root giving 
the damping factor and the imaginary part the period of oscillation. 

No short and simple method exists for finding the complex roots of 
algebraic equations of high degree. Probably the root-squaring method of 
Qraeffe * is the best to use in most cases. This method gives all the roots 
at once, both real and complex. 

84. Principle of the Method. The underlying principle of Graeffe’s 

method is this : The given equation is transformed into another whose roots 
are high powers of those of the original equation. The roots of the trans- 
formed equation are widely separated, and because of this fact are easily 
found. For example, if two of the roots of the original equation are 3 and 
2, the corresponding roots of the transformed equation are 3”* and 2”, 
where m is the power to which the roots of the given equation have been 
raised. Thus, if m 64, we have 3®‘ = go* ^ The two 

roots of the given equation were of the same order of magnitude, but in 
the transformed equation the larger root is more than a hundred billion 
times as large as the smaller one. Stated otherwise, the ratio of the 
roots in the given equation is §, but in the transformed equation it is 

I/IO"-**, or 2®V3®‘ < 0.00000000001. The smaller root 
in the transformed equation is therefore negligible in comparison with the 
larger one. The roots of the transformed equation are said to be separated 

' i.u/I5suTt5r dcr hShcren nuncrisehm Gleichunffen, Zurich {1837,. 
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ujfien ihe ratio of any roof fo Ifce neii larytr « iwjItgtbU tn tomponjon 
utiA vnily 

85 The Root Squaring Process. The transformed equation is obtained 
by repeated application of a root squaring process The first application 
of this process transforms the given equation into another whose roots tn 
the squares of those of the original equation This second equation u tiien 
transformed into a third equation whose roots are the squares of those 
of the second, and therefore the fourth powers of those of the original 
equation The root squaring process u continued in this manner until 
the roots of the last transformed equation are completely separated 
We shall now explain the root squaring process and show the method of 
applying it 

Let the given equation be 

(85 1) /(i) — -f ‘ + a,** * -f- + -f a, — 0 

Then if Zi, z, Zm be the roots of this equation, we can write it m the 
equivalent form 

(1) /(*) —<1,(1 — !.)(* — — (z — z.)— 0 

Now let us multiply (f) by the function 

(8) (-l)‘/(-z) - (-l)-a.(-z-z.)(-x ,) (-X-Z.) 

— (i,(x-f x,)(x + x,) (x + x,) 

The result is 

(85 8) (- 1 )•/(- -«.*{** -X, •)(**“*.*) (x*-x.*) 

Letz*--y Then (78 2) becomes 

(3) 0(y) — a,*(F— ^i*)(y— X,*) (y — z,») — 0 

The roots of tb» equation are zi*,z,*, x,* aad are thua the squires 

of the roots of the given equation (65 1} Hence to form an equation 
whose roots are the squares of those of f(z) —0, we merely multiply 
/(x)-Oby (-i)-/(-x) 

This multiplication can be earned out in a aimple routine manner, is 
we shall now show Let ns first consider the sixth degree equation 

f(x) — a,z*4- c,r«4- a,z* -{-B,z* + o,x-f a,— 0 

Then 

( 1)V( x) "“UoX* 0,X*4- 0,** <hx* 4* 0«X* — 0|I + 0* 


N 


By actual multiplication we find 
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x^o + a7^ 

I* — 03® 


— 20-103 

2aiat 


— }" 200O4 

— 20103 



-1“ 20003 


■as* 


-{- 2a<a« 


+ a/ == 0. 


( 4 ) 


-j- O-i" I 

— SajOs 
20^0^ 

L<!t us consider next a seventh-degree equation, 

f(x) + CLi^’ + <hx* -j- atx^ -f -f OeX -j- Or = 0. 

Then 

(_ lyf^—x) ^ aox^ — Oix* + a;X* ~ 03I* -f a,!* — Ossr 4- 0*0: — a^. 

Multiplying these equations together in the ordinary manner, as before, 
we find 

I* 


ati ' x '-* — 0,* 

2:'== -f 03- 

a:« — 03= 

4 - Soofl’ 

— 2a, Os 

4~ 203O4 


+ 2 flo 04 

— 20,03 



200O3 


+ o«’ 

a;« — 03 * 

X* -f-Os* 

— Bojfl} 

-f 2 a, o« 

-—20507 

+ SojOo 

— - 203 O 1 


— 2 aiaf 




_arS=.0. 


A glance at equations (4) and (5) shows that the law of formation of 
the coefficients in the squared equation is the same whether the degree of 
the given equation be even or odd. In practice the multiplication is carried 
out with detached coefficients as indicated below; 


Od 

flo 

0, 

— Oi 

0; 

C; 

Bs 

— Oj 

0, 

a, 

-3( 

O3 • • • 

O3 • • • 

Oo* 

— ay 

Ol® 

O3* 

Oi® 

— Os® - • • 



— 20,03 

-}- 2020, 

— 203O3 

20,08 ' ' * 



+ 2oi,o, 

— 2a, 03 

•4 2a;a8 

— 20-07 ’ • • 




-f- Zotflz 

— 2010, 

+ 2 n,fl, • • ■ 





+ 2 aoa. 

— 20,09 • • • 






4 2aoaio • • • 

60 



h 


h 
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The coefficiente in the ne7 equation are the sums &«, (i I, of the 
several columns m the scheme above These coefBcients can evidentlj be 
written down according to the following rule 

1 The numbers tn the top row are the squares of the coeffietenls directly 
above them, wxih olfemaitn^ et^iu — the second, fourth, sxxth, etc squared 
numbers betn^ negative 

2 The quantities dtreefly tinder these squared numbers are the doubled 
products of the coe^oents equally removed from the one directly overhead, 
the /int being twice iAe product of the two eoeffinents adjacent to (\e one 
overhead, the second the doubled product of the next two equally removed 
coefficients, etc 

3 The signs of the doulltd produtis are cKanyed alternately tn yotny 
along the rows and also tn going down the columns, the sign of (Ae first 
doubled product tn tack rote not being changed 

We shall now apply Oraeffe’a method to three cases of algehraic eqnationi 

86 Case I Roots all Real and Unequal Since the relations betweea 
the roots Xi, 0°^ coefficients Ot> a, ol the general equation 

o! the nth degree 

+ 4i*" •+ +o,,x + o, — 0 

are 

““•“•(*1 + **+ +»•)» 

— — + (*ir* + »i*. + ), 

^ ), 




it follows that the roots x,”, r," x.~ and coefficients bo, 6|, 

the final transformed equation 


!.,(*")• + J, (*«)•* +J, + — 0 

are connected by the corresponding relations 

— (xi'+x,"+ +*■”) 

■— (‘+S+1P+ +^). -- 


b. of 
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h 

bo 




1 + ^ + ^ + ' ■ ■ )> 
{ S*'’ 


4-. . 



(— l)«a;i"i2'"- • -Xn”. 

Oo 

Now if the order of magnitude of the roots is 

1 Si I > K I > 1 iCa I • • • :> I a:n 1 , 

it is evident that when the roots are sufficiently separated the ratios 
si"/si", Sj"/!-", etc. are negligible in comparison with unity. Hence 
the relations between roots and coefficients in the final transformed equa- 
tion are 

1", 

Oo Oo Oo 

■=’ ( — l)’’Si'^2*"Sa” • • • Srt” 

Oo 

Dividing each of these equations after the first by the preceding equation, 
we obtain 



Hence from these and the equation 6i/6o = — Xi'”, we get 

(86. 1) boXj" bj = 0, biij" -f- b: = 0, bzXa*" -j- ba = 0, • • • 

bn-iXn^ -{- bn = 0. , 

The root-squaring process has thus broken up the original equation into 
n simple equations from which the desired roots can be found with ease. 

The question naturally arises as to how many root-squarings are necessary 
to break up the original equation into linear fragments. The answer is 
that the required number of squarings depends upon (1) the ratios of 
the roots of the given equation and (2) the number of significant figures 
desired in the computed roots.' Since the required roots, and therefore their 
ratios, are not known in advance, it is not possible to determine beforehand 
just how many times the root-squaring process must be repeated. This, 
however, is a matter of no importance, for in practice we continue the root- 
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squanng proetss unlit the doubted produclt tn the second rov have no iftd 
on the eoefficxents of the next imnsformtd equation. 

Since the coefficients in the given equation are not m general all posifare, 
the signs of the doubled products mil not occur in regular order as in the 
literal equations which we used to illustrate the root-squaring process The 
possibilities of making a mistake in the signs of these produ'^ are great, 
and therefore some scheme should be adopted to prevent such mistakes Ai 
a convenient notation for reminding us at each step as to whether or not 
the sign IS to be changed we shall write a " o *’ after each term in which the 
sign 13 to be changed and an "ft** (for no change) after each term where 
the sign IS not to be changed 

Furthermore, as the root-squaring process necessarily increases the coeffi 
cients m the transformed equations until they become enormously large 
numbers, we shall always write these coefficients as simple numbers molti 
plied by powers of 10 

Finally, in the successive transformations of the equations by the toot 
squaring process, we shall not write down the multiplier (— 
as was done in the scheme on page 22o but simply spplv the rule stated 
on page S26 We shall now compute all the roots of an equation by 
Graefie’a method 

SiampU 1 Find all the roots of the equation 

1 23*' — 2 62a- — 16 U* + 12 8r» + 29 4w — 1 34 — 0 


Soluiian. The prelimmary work of separatmg the roots u given on the 
foUowing page and should be self-explanatory m view of what has been said 
above When doubled products are too small to be written down, a star (•) 
18 written instead. 

It IS evideut that further equaling will simply give the equates of the 
coefficients in the last Ime of the table, and we therefore stop with the 
32d powers of the roots Then by (88 I) we have the following five 
simple equations 

(7 641 X — 2 346 X 10” — 0, 

(~ 2 346 X 10 ”)*,” -I- 3 95 X 10" — 0, 

(3 95 X 10”)r," — 8 7U X 10“ — 0, 

(— 8 744 X lO”)**” -f- 2 148 X 10" — 0, 

(2 148 X 10 ")*," — 1 176 X 10* — 0 






32nd p. 7.64M0* -2.34G-10" + 3.95-10” - 8.744-10« + 2.148-10« ~ 1.176*10« 
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Solving these by logarithms, ve bAve 

log .. _ _ 0 60915 

®i — 4 066 

In a similar manner we find 

j, — 2 091, *, — 1959, *, — 10285, *, — 0 041« 

The signs of these roots are yet to be determined To do this we first 
apply Descartes’s rule of eigna and find that there can not be more than 
three positive roots nor more than two negative roots Then we substitute 
in the given equation the approriraate values ri: 4, ±:3, -tZ, ±1, 
It: 0 04 and see whether the positive or negative value comes nearer to 
satisfying the equation In this manner we find that the roots a^, 

^ 4 066, 

X, — —2 991, 

*, — 1 959, 

— 1 0285, 

*, — 0 0445 

The sum of these roots is 2 050, whereas it should be 2 52/1 23 — 2 049 
The agreement is therefore as close as could be expected 

87 A Check on the Coefficients in the Keot Squared Equation All 
roots found by GraeSe’s method should be carefully checked by some 
means or other The coefiicienta in the root squared equations can be 
checked by a process due to H Bainbow * The root squared equation 
(85 2) can be written in the form 

(67 I) (-I)-/(x)/(-x)-F(s:*)-d,(*')-+A,(*')-^ 

+ A, (**)—+ + 

To derive Rainbow’s check formula we put * — 1 and * •— — 1 m (85 1) 
and (87 1) Then we have 

/(I) — tfo + <*1 +®* + a* I -1-®, — S'U 

/(—I) -®o(— l)'‘ + a,(-l)-* + «,(— 1)**+ 1) + “* 

-2 (— 

P(l) - X, + A. + A, + + d, , + d,- S d, 

* R Raiobow, mthera&ticiu at tbe Research Laboratory of the Shell Oil Company, 
Houston Texas 
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On substituting these in (87. 1), we get 

(87. 2) i At = (- 1 ) -■ [ i n J [ i (— 1 ) 

0 0 0 

which is Rainbow’s check formula. 

This formula is applied as follows ; 

(a) Find the algebraic sum of the coefficients in any equation, either 
the given equation or an equation whose roots are powers of the roots of 

n 

the given equation. This gives the factor 2 Ot . 

0 

(b) Change the signs of the coefficients of the odd powers of x in the 
equation mentioned in (a) and then find the algebraic sum. of all the coeffi- 

n 

cients. This gives the factor 2( — • 

0 

(c) Find the product of the sums found in (a) and (b) and then 
multiply this product by ( — 1 ) ”, The result should agree very closely 

with the algebraic sum (2Aj:) of the coefficients in the root-squared 

0 

equation next below the given equation. 

Example 1. Let us apply Rainbow’s check to the first root-squared 
equation in thti table on page 229. 


Here 

n = 5, i at ^27.97, i(— — 1.09. 

_ 0 0 

Hence 

(— 1)='(27.97) (— 1.09) = 30.4873. 

The sum of the coefficients in the root-squared equation is 

b 

2 Afc -= 30.2.=)7. 

0 

The lack of agreement is due to the fact that the coefficients in the root- 
squared equation are rounded numbers multiplied by powers of 10. If 
the root-squaring process is carried through without rounding any numbers, 
we find 2A '= 30.4873, as the formula requires. 

Example S. Applying Rainbow’s formula to the coefficients in the 4th- 
power equation of p. 229, we have 



232 GHAEFFES ROOT^UARINO METHOD tCai? XI 

i — 80,000, 2(— 1)* ‘a* — — 1,696,000 

Then 

(— l)’[2ai.] [2(— — 136,000,000,000 

Kow finding the sum of the eoeflicjents in the 8th pawer equation, we get 
— 136 000,000,000 Here the agreement seems perfect, but such is not 
quite the case The zeros occnp; places of unknown digits which wert 
cut off in rounding the squares and products The onl; reliable Bigmficant 
Bgures in these sums came from the largest coefiicieots, that is, the 
coefficients containing the highest powers of 10 

Although the Kainbow formula cannot giro an accurate check in a 
numerical example, because the coefficients m high powered equations are 
so large that they must be expressed by a few digits multiplied by powen 
of 10, it will nerertheleas detect any large error in the process of squaring 
the roots 

88 Case 11 Complex Roots When tome of the roots of an algebraic 
equation are complex, the equation can not be expressed as a product of 
linear factors with real coefScieats Such an equation can, however, always 
be expressed as a product of real linear and real quadratic factors, each 
quadratic factor corresponding to a pair of complex roots The root 
squaring process can therefore never break up euch an equation into linear 
fragments u in the case when all the roots are real and unequal 
When an equation has complex roots, the root squaring process always 
breaks it up into linear and quadratic fragments The real roots, if any, 
are found from the linear fragments as in Case I, while the complex roots 
are found from the quadratic fragments 

In transforming an equation by the root squaring process the presence 
of complex roots is revealed in two jvgys ( 1 ) the doubled products do 
not all disappear from the first row and (2) the signs of some of the 
coefficients ffuctuate as the transformaliODs continue The reason for these 
peculiarities can be seen by considering a typical example 
81a) Deltctxon of Complex Bools Let us consider an equation hamg 
two distinct real roots and two pairs of complex roots Let these roots be 
*i> r,e **, rt« **•, and let the order of their magnitude be 

I I > Tk > 1 X, I > r, 

Then the equation having these roots is 

( 1 ) (* — *.)(* — 

X (x— x,)(r — r,s«>)(2: — »’i< ***) 
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The equation frbose roots are the mth powers of the roots of this equation 
is therefore 


(2) (y — si”) (y — (y — 

, X (y — a;*’") (y ^ (y — => 0^ 

where y •=“ s”. 

On performing the indicated multiplications in (2), then taking out the 
factors xm", arrrr" 4r,"'r,'"'3:3”, and neglecting the ratios 


r," Xs" T;'" Xs^ ^ r;”* 

x^ ’ ' 5?> ’ ’ ri" " Xt” ’ 


since each of these is negligible in comparison with unity, we finally get 

^3) y 9 _ xi^y' -f 2xt”ri^ cos me,y* — x,"ri^’"y* -f Xi’”ri'"x,’"y= 

— 2ii’”ri^'"is’^r2’" cos Tn 0 ;y + ii’^ri^’^Xs^ri""’ = 0 . 

The roots of the original equation have now been separated as much as 
they can ever be (since in deriving (3) we neglected such ratios as n”/®!” 
etc.), and the given equation has been broken up into the linear and 
quadratic fragments 

■y‘ — 

— Xi"y® -}- Sxi’^i” cos — Xi”ri’”y* = 0 , 

^ — Xi^fi-^y* -h ^t^ri'^xs^y* ■= 0, 

Xi^ri'^Xj^y* — 2xi*"ri"”X3’"r2” cos mfioy Xi’^i®'"is"'r2®” «=» 0 , 


from which we can obtain the original roots with which we started. 

Suppose, now, that we apply the root-squaring process to (3) once more, 
08 shown below: 



V* 

!/» 

y* 


nth p. 

I 1 

-X," 

cos tr9i 

— ii'Yi*'' 


1 

-SjJ» 

-}-4ii"rj" cos viSi 1 

cos* trtSi 

— 2xr"r,*** 
-f2xi"rr’'xa" 

— xi*"ri*" 

-b4xi*"ri”’x,” cos mOi 
— 4xj'"'ri*"x,'"rj*" cos mBt 

"•nthp. ' 

1 

-r,'" 

-b4xi*~ri*’' cos' TrJi ^ 
-2xr’Vi*" ] 
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F* 


nth p 


— cos jnS, 



+i£i*^i.—Xi^rf" eoa mC, 

— cos* m$i 


Smth p 


— cos* mil 
+2r,»-ri*-r,*-r^ 



It IS readuy seen on diTiding the donVIed products in each colomn h; 
the squared term at the top that all these products are negligible except 
two in the first row Hence the snins of the sereral columns are as girea 
above This result shows why the doubled products in the fint row do 
not all disappear when the complex roots are present. 

Purthermore, since 2 cos* — 1 — cos 2^, we can wnte the coefficients o! 
y* and y in the forms 2s,*"<'i*"co8 2»i»d, and — 2ii*"fi**Xi*“ri’"co8 2nJj, 
respectively Hence the coefficienta m the last transformed equation an 
simply 

(8) Smthp I -- * 1 ** + 8x»**ri*" cos 2fnPi — + *t*"Fi‘**i*" 

— cos 2m9, + 

On comparing this last equation with the one for the mth powers of 
the roots we see at once that each appLcation of the root-squaring proceat 
doubles the amplitudes of the complex roots Hence the cosines of these 
amplitudes must frequently change signs as the amplitudes are ccntinnillj 
doubled. This explains the fluctuation in the signs of some of the coeS 
cients when complex roots are present. 

After the original equation has been broken up into linear and quadiahe 
fragments by the root squaring process, we can find the complex roots by 
solving the resulting quadratic equations for *" and then extractmg the 
mth root of the results by means of De lloivre’s theorem But by pro- 
ceeding ID this manner we would bare ambiguities of sign in the computed 
roots, and such ambiguities are not easily removed To obtain the complex 
roots without ambiguity as to signs we derive some further relation* 
between roots and coefficients 

dfi) RtlattoM between the Coefficients of on Algebraic Equation and 
Reciprocals of Its Roots In the general equation 

0,®" + OiZ**» -t- o,r*-* + +o,.i* + o, = 0 


N 
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let US put X 


1/y. The result, after clearing of fractions, is 




0 . 


Hence from the well-known relations between roots and coefficients {p. 226) 
we have 


an 


= — (l/i + y: + * * • + !/»), 


= l/iy: + 2/1^3 + ■ ■ ■ + y=!/s + ■ ■ ‘ J 

On 


- - yn; 
On 


or, since t/ => l/i, 


( 6 ) 


^ + ^ + 


1 

IjS- 


1 


XiXi 


_ I Un-1 

+ ■ ■ ■ + + ’ ■ ■ + 
X1X3 


Un-2 


2^n-l®n 


On 


^ XjXjIj • ■ • X„ 


(- 1 )' 


These relations between the coefficients and reciprocals of the roots vrill 
help us to avoid ambiguities of sign in the computation of complex roots. 


Example ff. Find all the roots of the equation 

x^ — 2i* — 3x* 4- 4i= — 5x 4- 6 == 0, 

iSoIufton. The preliminary work of separating the roots is shown on 
pages 22G-227 and should be self-explanatory. 

It is evident from the last application of the root-squaring process that 
another application would effect no further separation of the roots. Hence 
we stop with the 25Gth powers of the roots. 

The given equation has now been broken up into three linear and two 
quadratic fragments. "Vve first compute the real roots from the linear 
fragments. 

For the first real root we have by (86. 1 ) 

Xi«' == 9.084 X 10”, 
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from which we find bj logarithms 

1 9€26 

The second teal root u loimd from 

(—9 084 10’*) i,*»* + 6 472 10‘” — 0 
Solving this by logarithms, we find 

**>-15379 

The next two roots are complex, but the fifth, a real root, is found from 
the equation 

(3 879 10'’») *,*‘* — 9 852 — 0, 

from which 

*. — 11080 

To determine the signs of these roots we first apply Descartes’s rule of 
signs to the original equation and find that there can not be more thsa 
one negative root The other two real roots must therefore be positive. 
On substituting in the original equation the rough valoes A we find 
that — 2 nearly satisfies the equation Hence *« — — 19625 The three 
real roots are therefore 

^ _ 1 9625, *, — 1 5379, — 1 1080 

The modulus of the first pair of complex roots is found from the 
quadratic equation 

(a) (6 472 10‘”)y*+ (2 093 10‘”)y + 3 879 10*’* — 0, 

where y — i”* Let r, denote this modulua We find r, by means of a 
simple theorem conecting the coefiicieDts of a quadratic equation with the 
modulus of its complex roots 
Let the quadratic equation 

(b) 




** + b* + e — 0, 
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have the complex roots re** and re“**. Then 

I* + + c ^ — ’■®”) — *'®“**) 

s s* — r(e** + e-**) + r* 

— (2rcos0)®4-r*. 

Hence c=-r®, — 6==»2rcosfl] that is, the absolute term in the quadratic 
(b) is equal to the square of the modulus of its complex roots. 

Let Ri denote the modulus of the complex roots of (a). Then on 
dividing the equation through by 6.472 X 10**® and applying the theorem 
just stated, we get 

3.879 X 10” 

6.472 

Since, however, Ri ■== we have 

3.879 X 10” 

6.472 

Solving this by logarithms, we find 

ri -=. 1.2909. 

The modulus of the second pair of complex roots is foimd in like manner 
from the quadratic 

(— 9.852 X 10»®)r + (0.163 X 10"®)y — 1.618 X 10“® =• 0, 


(c) or 


, 0.163 X 10® 1.618 X 10® 

^ 9.852 ^ 9.852 


Denoting this modulus by rj and that of (c) by R 2 , we have 


1.618 X 10® 


from which 


, or r-® 


1.0618. 


1.618 X 10° 
9.852 


Now let the two pairs of complex roots be denoted by 

+ it'i, .Ui — iVi, and u. + it;., Uj — tv., 

respectively. Then since the sum of the roots of the given equation is 0 
we have ’ 

Xi + X2-\- 2ui + 1* + 2u, — 0, 


+ ti, 0.3417. 
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We next apply the theorem conoectiog the aum ot the reciptocilj of 
the roots with the coefBciesta of the given equation, namely 

1.1. 1 ■ 1 . 1 . 1 . ^ _S 

I, s, Uj + tv, — »i>, u»4-«* «t — w,"*? 

Hationaltzing the denominators of the complex terms and putting Ui’ 4 
— fi’, 4 V,* — r,*, we get 




h 

6 


Now substituting in this equation the numerical values 


i-— — 0508386, 

X, 

-i- — 0 6502374, - —0902527. — — 060010, 0 88698 

and dividing through by 2, we obUm 
(a) 0 6001u, + 092875u« — — 010552 

Solving (d) and (e) simultaneously, we find 

u, — — 0 644S, u, — 0 3028 

Vi and Vt are found from the formulu Uv — V^i* — «i* •" V 
and V, — ^ V'{r»+«i)(^*— «») to be 

u, — 11185, 0,-1 oie 


Hence the two pairs of complex roots are 

— 0 6445 ±. 1 1I8« and 0 3Q28 10l8i 

We have thus obtained the complex roots without any ambiguity of signs 
The computed roots m this example can be checked by substituting the 
values of the real roots and moduli m the known relation 


— — 6 , 


log(a:,ar,r,^,r,*) — log 6 
These logarithms are found to be 

0 77816 — 0 77815 


The agreement is thus as close aa could be expected 
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Remark. If an equation contains more than two pairs of complex roots, 
the moduli of the roots can be found from the quadratic fragments as in 
the example above. Then the real parts Us, ' ' ' cs’i be foimd by 
making further use of the relations connecting the roots and the reciprocals 
of the roots with the coefficients of the original equation. 

In some equations of high degree it might be advantageous, after finding 
the real roots, to depress the original equation by taking out the real roots 
and leaving only the complex roots. This is conveniently done by synthetic 
division. The relations between the roots and coefficients of the depressed 
equation should then be used. 


89. Case III. Roots Real and Numerically Equal. If two roots of an 
equation are numerically equal, the root-squaring process can never break 
up the equation into linear fragments. One of the doubled products will 
always remain in the first row. This product will be just half the squared 
term above it, as can be seen by considering an equation of the third degree. 

Let the roots of 

(1 ) -k ayx^ -{- 0-2: -f Os 0 

be Xi, Xt, Xs. Then the equation whose roots are the mtb powers of those 
of (1) is 

(y — Xi") (y — Xj") (y — Xj") =- 0, where y -=• i", 
or 


yj _(x^m ^ ^ -f (Xj"Xj" Xa^Xj^-k X2"Xs’")y — Xi^Xj^Xj” — 0, 


or 



Now let x- ij and let ] Xi ] > | Xi | . Then for sufficiently large values 
of m the ratio x-"/^r is negligible in comparison with unity, and (2) 
reduces to 


(3) 


■ iry* -k Sxj'^.'^y _ , 


0 . 


The roots of the given equation have now been separated as much as 
they can ever be. but we shall apply the root-squaring process to (3) to 
sec what happens. Using only the coefficients, we have ^ ' 
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It Will be noticed that the first doubled product » negligible la cod 
panson vith the squared term above it, whereas the second is of the ismi 
order o/, magnitude as the squared term above and just half os {arje 
Furthermore, in the equation for the 2mth powers of the roots all the coeS- 
cients except one are the equatea of those in the preceding equation Thu 
Temaining one is only half the square of the corresponding coetEoenl m the 
preceding equation These peculiarities enable us to detect equal real roots 
immediately We shall now show how to compute such roots 

Sxamplt S Solve the equation 

5x* + 2*’— 15a — 6 — 0 

Soluiian. 


Qivea e^<ia 

$ 

lJ 1 


-6 


35 


235 

+24 e 

-55 

Tdp 

25 


+2 49 10> 





+8 2001 10* 
-1 1008 e 


4th p 

0 25 !0> 

-1 1268 to* 

+6 0993 10* 

-1 296 10* 


3 9062 10* 

-1 289 10* j 
-hO 637 n ' 

+2 800 10* 1 
-0 029 e ' 

-1 880 10* 

8th p 

3 906 10' ' 

-0 832 10* 

+2 671 10* ! 

-1 680 10* 


1 520 10<‘ 

-3 994 10 ‘ 

+2 ooa 

+8 810 10>* 

-2 822 I0'> 

16th p 

1 S26 IQ» 

-t 986 IflW 

8 610-10>* 

-2 822 10" 


The given equation baa now been broken up into the simple frsg 
ment (6 610 10**)j/* — 2 822 10** •— 0 and the quadratic fragment 
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1.526 • — 1.986 • + 6.610 lO^® = 0. Solving too Bimple 

fragment by logarithms, ive find 

Xi = 0,3999. 


To find the roots of the quadratic fragment we write the equation in 
the form 

6.61 X 10^ 


1.986 X 10^ 



1.526 


• 0 . 


Since the roots are known to be equal and since their product is equal to 
the absolute term of the quadratic, we have 

,_ 6.61XW 
'■ 1.626 ' 

Solving by logarithms, we get 

I, ^ 1.732. 


We check this result by putting the sum of the roots equal to the coeffi- 
cient of with its sign changed. Since the roots are equal, we have 


from which 


2ii"® 


1.986 X 10* 
1.626 ’ 


Xi — 1.731. 


We shall nest determine the signs of these roots. By Descartes’s rule 
there can not be more than one positive root nor more than two negative 
roots. Hence we try i 0.4 and find that — 0.4 satisfies the given equation. 
The other two roots are therefore ± 1.732. 

90. Brodetsky and Smeal’s Improvement of Graeffe’s Method. The 
Qraeffe method as explained and illustrated up to this point is sufficient 
for finding the real roots and one or two pairs of complex roots of an 
algebraic equation. When an equation has three pairs of complex roots, 
they can be found without much difficulty by making further use of the 
relations between roots and coefficients; but since one of the real parts 
(u’s) must be found from a quadratic equation, thus giving two values 
of u, the proper value must be determined by trial. When the given 
equation has four or more pairs of complex roots, the practical difficulties 
in finding them are almost insurmountable. 

Brodetsky and Smeal * avoided all these difficulties by moving the origin 

* •* On Grsetfe's Method for Complex Roots of Algebraic Equations,” by S. Bro- 
detsky and G. Sme&t, Proc. Comb. Phil. Soe., Vol. 22 (1924), pp. 83-87. 
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of z a small distance < and then applying the root squaring process to the 
transformed equation Their procedure enables all roots to be fotmd 
without an} ambiguities and without much additional labor after the 
roots of the transformed equation have been separated The Brodetsrj 
and Smeal improsement enables an; number of pairs of complex roots 
to be found with the same ease as one or two pairs The introduction of 
the auxiliary variable < more than doubles the labor of separating tht 
roots but does not cau e any other additional labor in the solution We 
present the Brodetsky and Smeal method m slightly modified form and 
apply it to two examples 
Consider the general equation 

(1) I* + a,*" » -}- ii,z« * + -f a, — 0 

and put 

( 2 ) + 

where « denotes a smail variable whose squares and higher powers er« 
negligible On substituting (2) into (1), we have 

(r' + O- 

(3) 

+ + a^i(*' +«) +0, — 0 

Expanding the binomial quantities by the binomial theorem to only tvo 
terms, thus neglecting all terms involving <*, etc, we get 
ar'» + fiy- «« + * + (n — !)#'• »«) 

+ <!,[*'• ‘+(n—2)r'-*cj-f -0, 

or 

(4) z'-.f (a.-fnOx'-* + ta, + «.(n — -0 

The coot squaring process is now applied to the transformed equation 

(4) instead of the original equation (1) The root aquaring is carried 
out by applying the rules stat^ lu Art 85, neglecting all t*’8 wherever 
they occur The rules must be applied to the enfire coeS^cxents (including 
the c terms) of the z' terms In the root squaring table the terms con 
taming t will be m rows below the rows of terms not containing < 

Before proceeding to work the illustrative examples we digress to derive 
the neces«ary formulas for finding the roots from tlie linear and quadratic 
fragments The fragments will contain < When written as equations 
according to (86 1), the hneac fragments will be of the form 

(5) + 

where m denotes the power to which the roots of (4) have been raised 


Am. 00] BRODETSKY AND SMEAL’S IMPROVEMENT 

From (5) •we have 


245 


j/m, 






Ai 4* 


4.(. + J.l 


-4[-+e-i)']. 


where has been neglected in the division to get the expression in 

brackets. On replacing a:' by x — < from (2), we obtain 


{x-.y 


■ mx 




Ai \.4: Ai/ 


Since this is an identity in <, the coefficients of like powers of « in the 
two members of the identity are equal. Hence we have 


( 6 ) 

and 

(7) 


At 

At 


■mx” 


h 

At 


2 / Bt Bi \ 

7Vi;“ir; 

Dividing (7) by (6) and solving for x, we obtain 

( 8 ) 


-m 


At At 

The value of x should be found from both (6) and (8) as a check, the 
latter giving the correct sign of x. If the two values do not agree closely, 
there is some error in the root-squaring computation. 

The quadratic fragments when equated to zero will be of the form 

(9) 

or 


( 10 ) 

where 

( 11 ) 


{At -}- Btc)y~ 4* (^2 4~ ^2t)y 4* (-^3 4~ Bsc) = 0, 

0 , 




■^i4‘-Bit^ ‘ ill 4* Bit 
(x')”= (x — <)"= (rc‘-« — e)" 
From (10) we have 

/l2(i4-^t) ii3(i4-:?i0 

l/*4- 4^1,4- 


^(14-^t) ^i(14-:|l,) 


At 


0 , 
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y*+ 




where, in the division, we have neglected <* as before 
The product of the roots of (12) equals the constant term Hence vt 
have 




The product on the left becomes (r * — -^-e **)]" when «• is neglectei 
Expanding this to two terms by the binomial theorem and replacing 
gii^g ii by 2cos0, we get 


(13) 




Now equating coefficients of like powers of t in both sides of the equation, 
we obtain 




(14) 

and 


— •2mr*‘" ‘cose- 


Irom which 




„ r* /B, B.\ 

rcostf — — “I-; 

2m\4ly A,/ 

But rcos0~u, the real part of the complex root Hence we have 



Then 

(16) o— Vv* — u* 

The real roots of an equation are to be found from formulas (6) and 
(8), and the complex roots from (14), (15), and (16) 

Example 2 "Find the roots ol the equation 

x> -f 3i* — ** — 2** — 2x — 1 — 0 
Solulton We first put x— ar'-)-* Then the equation becomes 
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(j' + «)' + sex' + £)« - (cr' + + <)* — 2(2^ 4- ^) — 1 = 0- 

Expanding the binomials to two terras and rearranging the coefficients, 
we find 

s'* + (3 + sOx'^ — (1 — 12 £)x'* — (2 + sox'* — (2 + 4€)x' — (1 + 2c) = 0. 

The root-squaring of this equation is shown in full in the table on 
pages 248-249. 

The table shows that the roots are completely separated by the 6th 
squaring (G4th power). The table also shows that there are three real 
roots and one pair of complex roots, the midterm of the quadratic frag- 
ment being in the column under x'". 

Since the 6th is the last squaring to be made, the parts of the coefficients 
not containing t’s and the parts multiplied by < are placed in separate 
lines, the first line being designated A and the latter B. The quotients 
B 

— are placed in a third line for use in the formulas for finding the roots. 
A. 

To find the first real root, we substitute into formula (6) the first two 
terms in line A and thereby obtain 


1.1528X10”. 

Hence 

64 log X, — 32 -flog 1.1528 = 32.06175 
log Xi = 0.50096 
Xi = ± 3.1693. 

■ B B 

Now substituting the ratios and into formula (8), we get 




A, A^ 
64 


20.194—0 


-3.1693. 


This result agrees with that found above and also gives the sign of Xi. 

To find the second real root, we substitute into (6) the second and 
third terms of line A and thus have 


^ 1.74874 X 10” 1.74874 X 10* 

^ “ 1.1528X10” 1.1528 

Then 

64 logx, = 4 -f log 1.74874— log 1.1528 = 4.18098 
and 

log Xi = 0.06533 
xt~ ±1.1623. 
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Then from (8) we get 


• 34 867 — 20194 


which shows that this root is positire 
The third root is found frcm the last two terms of the Imes A, B, 


* 2 10729 X 10’* 

64lQg*»— — 14— log210T29 — — 14.32372, 


logr,~ 


i — — 0 22381 — 9 77619 — 10, 


From (8) we hare 


* 128—20913 

The complex roots are found from the third and fifth terms in re»i 


4 r /2 10729X 10^ 

” >1 74874X10“*" VI' 


210729 


1 74874 X 10“ V 1 74874 X 10“ 

logr* — ^ (log2 10729— 22— logl 74874) 

— —0.34248 — 9 65762 — 10 
r* — 0 4545 

Then from (15) and (16) we get 
04545 , 


128 


■ (20 913 + 34 867) —0 1981 


V — VO 4545 — 00392 — 0 6444 
Hence the complex roots are 

—01981*0 64441. 

The fire roots of the giren equation ere therefore 

— 31693, —0 5976, 11623, and — 0 1981 *0 6444i 
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The sum of these roots is —3.0008 and their product is 1. The solu- 
tions found are therefore correct. 

Example 2. The following equation arose in the investigation of the 
stability of a certain type of airplane.* Its solution is required. 

-f 20.42;" + 15L3x'> -}- 490z= + 687x* + Yigz* -}- 150z“ -f 109z + 6.87 

= 0 . 

SoluUon. Putting X’=x'-\-( and substituting this into the given 
equation, we have 

(i' -i- 20.4 (z' -f ty -f 151.3(z' -f c)« -f 490(z' + 1)* -f 687(i' -f e)« 

-f 719(z' + <)* -f 150(z' 4- <y -f 109(2;' -f t) + 6.87 = 0. 

On expanding the binomials to two terms and rearranging the coefficients, 
we get 

2;'* -f (20.4 -f -f- (151.3 + 142.8t)z'« -f (490 + 907.8£)2;'» 

+ (687 + 2450£)z'< -f (719 + 2748£)i'^ -f (150 -f- 2157£)2;'» 

-h (109 -f 3000a;' + 6.87 -f 109t = 0. 

The successive steps in the root-squaring of this transformed equation are 
shown in the table on p. 252. To save space, only the successive equations 
are shown, with the exception of the last squaring. The complete results 
of the fifth squaring (32nd power) are shown to enable the reader to 
distinguish at a glance the linear and quadratic fragments. Under the 
middle term of each quadratic fragment is written the abbreviation "cos.” 
The table shows that there are three pairs of complex roots and two real 
roots. 


The first real root is found by formulas (6) and (8) from the first 

B 

two terms in lines A and t. We have 

A 

— 3.2920 X 10"* 

32 log Zi = 28 -f log 3.292 -= 28.51746 
log Zi-= 0.89117 
± 7,783. 


Applied Aercdirnaniet, by Leonard Bairsfow. New York, 1020, p. 493. 
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Also, 




— 32 
4.1236 


= _ 7.760. 


Hence the required root is 

I, = — 7.78. 


The second real root is found from the last two terms in lines A and 
. We have 


Also, 

We take 


„ 0.605 X 10-’ 6.05 

1.8572 X 10®* ~ 1.8572 X 10^» 

32 log ig =■ log 6.05 — 38 —log 1.8572 « — 37.4871 
loga:8 = — 1.1715 = 8.8285 — 10 
18 =^ 0 . 06738 . 


a-B 


— 32 

508.25 — 32.815 


0.06731. 


X8 = — 0.0674. 


From the first quadratic fragment and formulas (14), (15), (16), 
we have 


rx-> 


”/— 0.8317 X 10” ®’/0T7 

V — 3.2920 X 10‘«~' \ 3. 


X 10*” 


3.292 


logr.= = — (49 4- log 8.317— log 3.292 = 1.54383 


r,* = 34.981 

34.981 

64 


(14.377 — 4.1236) = — 5.604 


r, = V34.981 — 31.4048 = 1.891. 
Hence the first pair of complex roots is 


— 5.604 ±: 1.891t. 

For the second pair of complex roots we have 


r- 


[—6.7553 X 10®‘ 
— 0.8317 X 10” 


^’/ 6.7553 X 10** 
V 8.317 



GSirmrs ECOT-sQr\EtNG inriEos 


iCsir n 


Icffi r,* — p ( U -i- leg 6 — fcs S J IT ) ^ 

r,*— ei&245 

(53^1 — i4 JTT) — 0XST8 
r, — VSjy34S— 0 445?S — L3« 

T&e «eccs j pur cf ccaplex rods u tbea 

— 0€«T8-13«u 


Fcr the tlurd pur of ccesplez roots vr btre 

*“ V— « TW3 X 10** "" '6.Ti53 X 10** 

Icgr,* — — OTeTSS— 9^45— 10 


(J5JI5 — 335;i)-.0002818 


r, — VO i;03— (0 0«818)*— 0 415 

Tb« third pur of eonpI«x roots ts thca 

0IXI33I8£;0413(. 

Tfce toia of Use rods »e bste foced » — t0J9 »ad tbeir ptodwi 
IS t£72 

The Brodetsky uid SckoI EMthod m elegaat isd po»rrfol. uid eniMes 
the roots of eqaatioss of tnr decree to be foond caiquelr, bst it hxs the 
disuirant^e of gresUy locwuiag the Ubo” cf sepzrtticg the roots, with 
s correspc a diag mcreue in the passibilitr of errors m the rocl-eqainEg 
operstion. Errors ire most likely to oeenr in ccmpotiag tod recording 
the doubled prodocls — by forgetting to malUpIr by t, hj recording the 
results with the wrong sign, etc lo i laig compalition sadi errors cm 
be prerenled only by the obno^ sigilmce on the part of the ccrapoter 

For the reasons stated abore, the DrodeUky-Smeal method u not idnsed 
for solnng equations hanng fewer than three pairs of ecsBjdex roots. 
When an equation of the sixth or higher degree is to he solred, it is wdl 
to separate the roots first by the ordinary method, not using the t'a Ihea 
if it IS seen that there ate three or more pura of complex roofs, the giren 
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equation should be transformed to x’^s and <’s and the root-squaring 
repeated. The first root-squaring can be used as a guide and partial 
cheek on the second. 


91. Improving the Accuracy of the Roots. The accuracy of the 
roots found by the Graeffe method can be improved to any desired extent 
by several methods, one of the best being the Newton-Baphson method. 
Although that method was applied only to the computation of real roots 
in Art. 71, it is equally applicable to the improvement of complex roots, 
as we shall now show. 

A function of a complex variable z can be represented about a point Zo 
in the complex plane by the Taylor series 


( 1 ) 




n! 


(z— -Zo)’'-f • ' 


If we put 2 — Zo*=>ii or 2 -» 2 o-J-ft, where h is now complex, the series 

(1) becomes 

(2) /(2o + /')-/(2o) + Wo)+yr(^o) + ' • --f ^/(")(zo) + - • •. 

If Zo is an approximate value of a root of the equation /(z) =0 and 
h is a correction such that /(zo-f ft) =0, then (2) becomes 


(3) /(2o) +/<r(ro) +yr(2o) +• * - = 0. 

Since the modulus of ft is assumed to be small, we may neglect in (3) all 
terms higher than the first degree in ft. Then we get 


(4) 


ft 


fM 

f'M’ 


which is the Xewton-Raphson formula. 
The improved value of z is then 


( 5 ) 

Example. 


/'(=o)' 


Approximate values of the complex roots of the equation 


/(x) = X* — 3ar» -f 8x* — 5 = 0 
are 


20"= 1.39 ±2.471. 
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Find more accurate values of these roots 

Solution Since the imaginary parts of complex roots are always 
numerically equal and of opposite sign, it eufhces to improve only the 
root with positive imaginary part Hence we take 

t. — 139 4-247* 

Then since 

f(x)— 4z*— 

we have 

/(*o) — (1 39 -f 2 47t')‘— 3(1 39 4- 2 47*)* + 8(1 39 4 - 2 47*)* — 5 
f (*,) — 4(1 39 4 - 2 47*)*— 9(1 39 4 - 2 47*)» -f 16(1 39 4 - 2 

The nght hand members of these equations can be evaluated by direct 
expansions by the binomial theorem, but they can be evaluated with less 
labor by changing the parenthetical terms to polar coordinate form and 
then using the relation 

(a 4- h«)*""f*(casr9 -f- lam nfl) 

Using the latter method, we have 

r— V (1 39)*+ (247)* — 2 83425475 

1100., Hil ,.0871481295 
r 

1 30 

coa tf — — — 0 490428745 
J — 60® 37' 62 "44 


Then we find 

/(»,) — 0 1437—0 061074* 
f (*,)—_ 31 261339—25 288849* 


01437—0061074* 
3126 4-25 29* 


— 0 0018- P0034t 


The corrected value of s is thenfore 


and the improved complex roots are 


z— 13918:2:2 4666* 
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Carvallo * has extended Graeffe’s method to the solution of transcendental 
equations b}' expanding the equation into a Taylor series, neglecting the 
remainder term, and then treating the resulting polynomial as an algebraic 
equation. 

Note. If the leading coelncient of an equation is not unity, time and 
labor will be saved by first dividing throughout by the leading coefficient 
before beginning the root-squaring process. 

EXERCISES XI 

Find all the roots of the following equations: 

1. j:‘-f 7 . 182 :=' 1.83a: + 2=0. 

2. 2^ — 0.1272;= + 2.7552117a:- — 0.11123589a: + 1.0957115 = 0. 

3. 3.262:« + 4.22:* + S.OSa:’ — T.lOa:" + 1.922: — 7.76 = 0. 

4. . ^ — Oar* + 3a:* + 5a:’ — 6x + 2 <=■ 0. 

5. x’ + 3x* + 6 = 0. 

6. X® + 7.73x' + 12.84x« — 1.1 1 lx® — 55.7x* — 125.3x’ 

— 157.9x’ — 112.3x — 56.3 = 0. 


RttKiUithm Xvru'ruitic ilrs Equations, p. 24, 
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NUMERICAL SOLUTION OF SIMULTANEOUS LINEAR 
EQUATIONS 

Various method# hare beea derised lot the numerical solution of sunul 
taneous linear equations Some of the methods are of general appbcabih^, 
vhile others are somewhat restricted in their application Perhaps no single 
method is best in all cases In the present chapter some of the best general 
methods are eiplained and illustrated by numerical examples 
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92 Evaluation of Homerical Detenulnants. In the following pages 
it 18 assumed that the reader la familiar with the elementary properties of 
determinants to the extent given in the usual college algebras 
o) Expansxon »n terms of minors The minor of any element of a 
aeterminant is the determinant which remains after deletion of the row 
and column containing the element Any detenninant may be expanded 
in terms of the minors of the elements of any row or column The elements 
of the first row or first column are usually the most conrenient for sxpan 
lions in terms of minora Thus, the determinant 


a, a, tt, a, 
h, b, h« 

Ct tf 

<f, <f, d, (f«| 


may be expanded with respect to the elements of the first row as 


1 

5, b, M 


b, b, b. 


\bt bt bt 


bt b, b, 


Of c, e , , 


e, Ct Ct 


I C| Ct e. 

j —0. ■ 

c, Ct e. 


d, d, d.j 


d, dt d. 


i, d, rl, 1 


dt d, dt 

or with respect to the elements of the first column as 




b, b. 


a, a, a« 


0} at a. 


ttt a, Ot 

E = a, 

0, Ct c. 

~b, 

Ct Ct e« 

+ c. 

bt bt b. j 

— d. j 

bt b, bt 


dt d, d. 


dt dt dt 


dt d, d. 


e, c, Ct 


The teauUing third-order detenmnanta can be expanded by the rule for 
expar ling determinants of the second and third orders 
isS 
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Note that in the above expansions by minors the signs alternate, whether 
the expansion is with respect to the elements of the row or with respect 
to the elements of the column. 


Example. To evaluate the determinant 

3—125 
—2 3 4 1 

1 —3 2 6 ’ 

2 4 3 1 


we expand it in terms of the elements of the first row and have 



3 4 1 


— 2 4 1 


— 2 3 1 


— 2 3 4 

D = Z 

— 3 2 6 

+ 1 j 

12 6 

4-2 

1 —3 6 

— 5 

1—3 2 


4 3-1 


2 3 1 


2 4 1 


2 4 3 


= 129-}- 7S.}- 194— 385 = 13. 


Although the method of expansion by minors is simple and is very 
important theoretically, it is too long for practical use in determinants 
higher than the fourth order. 


i) The pivotal method. In this method of evaluating a determinant 
the order of the determinant is systematically reduced step by step, the 
leading element (called the pivot) playing a more important role than any 
other element. To derive the formula for the pivotal expansion, let us 
consider the nth-order determinant 


(1) 


N = 


Ol fli Os 

62 bs bt 

Cg Cf C4 
di dg dg dg 


Multiply the elements of the 2d, 3d, • • • nth columns by Oi and compensate 
by dividing the determinant by Ci"-’. Then 


Cl 

OgOg 

agOg 

(hat- • - 

bg 

Ogbg 

chbt 

agbt- • • 

Cl 

OgCg 

OtCg 

agCg- ■ ■ 

di 

agdg 

Ogdg 

Ogdg- ■ • 

' 


( 2 ) 


D = 1/a,"-^ 
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Now multiply the elements of the first column of (1) by ai,Oj, ,a, in 
succession end subtract the results from the 2d, 3d, nth columns of 
(2) We thus get 

a, 0 0 0 

hi a|6j — — a^bi Otbi — Oihi 

e, a,e, — a,c, tt,Ci — ix,Ci a,c, — o.Ci 

<2, a^dt — ttidi a^dt — a^di Oid^ — a,di 

which becomes 

a;6i— Ujii a,h»— fljb, aib«— ~a4hi 
a,c, — OjC, o,Cg — a,c, djC* — OjC, 

D = l/at** d,<fi — Otdt a,dt — 0|d| did,— >a,d| 


when eipanded by minors with respect to the elements of tbs first tow 
W e hare thus derived the unporUnt reduetioa fortDuls 



O] a« Ct Og 


— 0,bt Sibi — Oibi Aibg — Sg&t 


hi ; 1, h. 


#lC|“OfCj 

(3) 

Cl J C| Cg Cg 


a,d|^agd] Aidi — Sidi 0|dg*^a<di 


d, * d, d, d, 




Smee each application of (3) lowers the order of a determmant by one, 
a continued sppbcation of it will reduce any determinant to the third 
order or even to the second order 

Formula (3) shows that the first column of the new determinant of 
lower order is obtsined by multiplying by Oi each element m the first 
column of the minor of d, and then subtracting the product of the element 
at the top by the element at the extreme left The elements in the second 
column of the new determinant are obtained in the same manner This 
procedure should be memorized and applied as a working rule o, ftmes 
any eUment, mtnur tht element at tha top (tmes the element at the 
extreme left 

Example Applying this rule to the numerical determinant evaluated 
above by minors, we have 


D = 1/3,“*^ 
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3—125 


7 16 13 

— 2 ; 3 4 1 

1 

— 8 4 13 

1 1 —3 2 6 

“ 9 

14 5 —7 

2 ; 4 3 1 




1 117 

== i (_ 196 4- 2912 — 520 — 728 — 455 — 896) = -^ = 13. 

c). The triangular method. Another important method of evaluating 
a numerical determinant is to reduce it to triangular form and then take 
the product of the elements in the leading diagonal of the triangular 
determinant. A triangular determinant is one in which all the elements 
on one side of the leading diagonal are aero. Any determinant 


( 4 ) 


D = 


Oil flj2 * ' ' fljn 
^22 ®2S ■ * * ^2n 

flat fl32 flsa * * * flan 


I flni flni flna * * ' Ann | 

can be reduced to triangular form hy the following procedure: 


Jfultiply the first row successively by — , ^ and subtract the 

fljl Oil Oil 

results from the 2d, 3d, • • -nth rows. "We thus obtain 


( 5 ) 


whore 


Oil 

Ci]2 

OlS- 

’ Oln 

0 



‘ bjn 

0 

b32 

bj3 • 

■ ■ bgn 

0 



• -b^n 

0 


h„r 

* ^nn 


1 n 1 0.*1 

0 « 0;; flj;, Olj fljj — 


013, etc. 


^3- — Oj. “0,2, baa = (135 — ~Ois. etc. 

Oil a„ 

Now leaving the first row of (5) as it stands, we multiply the second 
row successively by and subtract the results from the 

3d,4lh,' • -nth rows of (5) and thereby obtain 



262 


( 6 ) 

■where 
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Sit Alt A|a 

0 &t, b„ 

0 0 Ctg e„ 

0 0 Cm 

0 0 Cm C«ii 

fill — 6tt~j“ 


e4t = ii.--^6M, etc 

By coatmuing this process we tedoce (4) to the trisnguUr foria 
All Alt Alt Cl* 

0 htt ^tt fit. 

0 0 c,» c,. 

0 0 0 d» 

0 0 0 0 I., 

The Ttlue of the originsl detennmant (4) u the product of the diagonal 
elements of (7), or 

(8) ^Stf|tfit|CM<{44 It. 

To prove this fact we eipaad (7) successiTely m minora with respect 
to the elements of the first coljmn of each successive determinant This 
fill fill fi*. C>i Om 

0 Cti Cm 0 (f„ dw 

0 0 

D = Om 0 0 =0.,fi„ 

0 0 0 0 f., 

0 0 Jm 

d*. d„ dgg 

0 «M e„ 

— AiifiMCii 0 0 

0 0 i*. 

and continue the expansions until we arrive at (6) 



% 
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If the elements of the determinant are inexact or rounded numbers, 
the denominators Cn, ba, etc. of the fractional multipliers should be as 
large as possible in order to reduce errors as much as possible. Inter- 
changes of TOirs or columns vrill usually enable the computer to bring the 
largest elements' to the positions of o,,, hj;, etc. 


Example. We now apply the triangular method to the determinant pre- 
viously evaluated by other methods. 

3—125 
_ — 2 3 4 1 

1 —3 2 6 ■ 

2 4 3 1 


On multiplying the first row successively by §, then adding the 
first result to the second row and subtracting the next two results from 
the third and fourth rows, respectively, we get 




2 5 
16 13 

3 3 

4 U • 

3 3 

5 _7 

3 3 


8 

Now multiplying the second row by — and 2 in succession, adding the 

first result to the third row and subtracting the second result from the 
fourth TOW, we get 


2 

5 

16 

13 

3 

3 

52 

65 

7 

7 

— 9 - 

-11 


rinally, on multiplying the third row by ^ and adding the result to 
the fourth row, we obtain 
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2frl 


Hence 



2 5 

H 

3 3 


« 65 
7 7 




= 13 


Concerning the merits of the three methoda giren shore for erslaating 
a numerical determinant, the method of expansion in terms of minors is 
the least desirable of the three Aa to the other tiro methods, the pirotal 
method is preferable when the elementa of a determinant are simple 
numbers of one or two digits snch that tbcjr can be multiplied and sub- 
tracted mentaUy When the elementa are numbers of several digits, the 
triangular method is the best method of evaluation 


93 Cramer'a Rule A aimple method of solving susnltueous linear 
equations by determinants was discovered by Oabnel Cramer* in 1760 
To derive Cramer's rule, as it is called, we consider a system of three 
equations 

5iS' + 6,y-f-6,s = J:, 
e,* + e,y-fc,*=sir, 

We first write down arbitrarily the determinant 


(2) 


(o,z-f o,y + o,s) a, o.| 
(hiX -1- hfy + his) h, hi ' 
(c,* -f c,y + c,s) e, c,| 


From (1) the elementa in the first column of (3) are equal to h,, kt, k, 
respectively Hence we may wnte 




1 (aiar-l-o,y + a,*) o, o»j Ifci 

(c,*-f-c,y-V-e,») e. c.| jlr. 
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The addition law of determinants states that the left member of (3) 
may be expressed as the sum of three determinants, as follows: 


aiT a-> fls 


a^y flj fls 


^3^ G* fla 

biX b, b: 

J- 

1 

bijr b, hi 


bz 

C-iT Cj Ci 


CiV c, Cj 


^3* ^^2 ^3 


Factoring out x. y, and r from the first columns of these determinants and 
replacing the left member of (3) by the above sum, w'e have 



a. 

ns 


fl. 


Ci 


Ci 

C: 

flg 


h 

Cl 

Ci 

hi 

b. 

bz 

x + 

hi 

6. 

hi 

y + 

bi 

hi 

hi 

z ■= 

k. 

hi 

bi 

Cl 

Cz 

Ci 


Cz 

Ci 

Ci 


Ci 

Cl 

^3 


h 

Cl 

Ci 


Since two columns of the second and third determinants on the left are 
identical, those determinants are each equal to zero and we are left with 


from which 


Qi Gj flj 


h 

Cl Ci 

5i b, bi 

X=z 

ki 

^2 ^3 

Gj 


h 

Cl Ci 


ki Cj 

Ci 



ki bi 

bi 




^3 



a, C; flj 

bi h, bi 

c, C. Ca 


To find the value of y we write down the determinant 


Cl 

(HjI - f o.y -{- OjZ) 

Ci 

bi 

{biX-{-biy-\-bsz) 

bi 

Cl 

{Cix Ciy + CiZ) 

Ci 


replace the elements in the second column by k\, k., k, from (1), and then 
proceed as in finding x. The result is 


a, ki Qj 

h. h h 

Cl i'j Cj 

a, a, Hj 

bi b, bi 

Cl r. c. 


y— 
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To And 2 we start with the deteminftDt 

a, a, (a,x+a^ + a,t) 
bi b, ((i> + iiy+ > 
e, e, (e,ar+c^+c* 2 ) 
and proceed as m the case of x This gires 

a, a, fc, 

&■ bt t, 
c, e, t* 

a, ttt 

b, b, bt 
Cl c, c, 

Xote that the nnemratora of the fractions giving x, y, and t are the 
same as the denominator except that the coefficients of the desired nnbiown 
are replaced by the known qaantitiea (the l*s) Hence CrameT’s ink 
may be stated as follows 

TTnfs douR fAe defermtnoRf cf the coe^etenfs of the vnknomu Any 
uninovm u efuoi to the fraciton whose denominator u fAs (fefemifwnt Of 
the eoe^ctents and uhose numerater u fAe same determinant with the 
eos^cisnfs of the desired unknown replaced by the known (consfant) terms 

Cramers nie holds for systems of any number of equations in the 
same number of unknowns and can be derived as was done above in the 
case of three equations 

Ezample Find y from the equations 

3r + 2y— 2 + fs:l 
z- y-2x + 4f = 3 

' ' 2x + Zy+ 2 — 2< =— 2 

.5r— 2y + 32 + 2f = 0 

Sotuticn The denominator of the fractions for all the unknowns is 



= i (_ 25 — 640 -f ?70 + 880 + 25 — 560) = 60 
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3 1—11 


8 —5 11 

1 . 3 —2 4 

1 

— 8 5 —8 

2 ; ^2 1—2 

9 

— 5 14 1 

5 ; 0 3 2 




50 50 


The other unknoTVHB are found to be ar=— , z = —^, i — 0. It will 

be found on substitution that these values satisfy equations (A). 

Although Cramer’s rule is simple and easy to apply, its use requires a 
great deal of labor when the number of equations exceeds four or five, 
because of the labor in evaluating the determinants involved. 


n. SOLUTION BY SUCCESSIVE ELIMINATION OF THE UNKNOWNS 

Several methods have been devised for solving systems of linear equa- 
tions by successive or step-by-step elimination of the unknowns. Three 
of the most important of these methods will be e.xplained in the following 
pages. 

84. The Method of Division by the Leading CoeflScients, The simplest 
of the step-by-step elimination methods is that in which each equation is 
first divided throughout by its leading coefficient, the equations being 
thereby transformed into a second set in which all leading coefficients 
are unity. To complete the first step, one of the transformed equations, 
which will be called the pivotal equation, is subtracted from each of the 
others (if all leading coefficients are positive), thus eliminating one un- 
known from the set. If the original set contained n unknowns, the first 
step reduced it to a set in n — 1 unknowns. 

If the same procedure is applied to the new system in n — 1 unknowns, 
we get a third set of equations in n — 2 unknowns; and by continuing the 
process we finally arrive at a single equation in one unknown. When the 
unknown has been found from this last equation, it is substituted into the 
preceding pivotal equation. The method of back substitution is continued 
until all the unknowns have been found, the back substitutions alwavs 
being made into the immediately preceding pivotal equations. The fol- 
lowing example should make the method clear. 
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EzampU Sohe tho equations 

475r — 31Cy— 407*4- 253< = 521 
296t — 4825—395* + 2421 = 720 
364t — 421y — 645* + 342( = 634 
282* — 286y — 315* 4481 = 266 

5elu(i0'i On dividing each equation throughout by its leading coefTicient, 
weget 

(a,) X — 0 (i6527y— 0 85684* -1-0 532641= 1 09685 

(a.) X— 1 G284y — l3345*-|-08ir58< = 2 4324 

(a,) *— 1 1566y — 1 7665* 4- 0 939oBt = 1 7418 

{a,) X— 10l4.>y — 1 1170* -f 1 58871 = 0 94326 

Now taking the fir't of these equations a^ pivotal equation and sub 
trailing it from each of the other* we get the neve set 

— 09C3ly — 04777* 4 0 284941 = 1 3356 

— 0 40l3y— 0 9097* 4 0 406941 = 0 6450 

— 0 3489y _ 0 2602* 4 1 056H = — 0 15359 

This completes the first step Suaeeding steps are carried out in exactly 
the same manner 

In prailicc, the solution is eihibiied in compact fotia as shoifn below, 
the unknowns being written at the top of the table and only the coefBcients 
shown in the work Since errors are liable to be made in the computation, 
checks are provided in each line of the table The column headed "Sum” 
gives the algebraic sum of the coefficients and constant term in each 
equation The cluck numbers were obtained by performing on the pre 
vious sums the same operations (divisions and subtractions) as were per 
formed on the corresjipnding previous equations For example, the check 
number 2 5b69 in row (6,) was obtained by dividing —2 4915 by --0 9631 , 
and the check number 0 7492 in row (5,) — (6,) came from subtracting 
i b'o'ift 'jTUrti 7) 'h'hVi Tire Vri/fti ifl ttie dhwVs is eninft ^rom ttre m-yibWi 
that if equals are divided by equals the quotients are equal, and if equals 
are subtracted from equals the remainders are equal Hence the sums 
should agree with the check numbers in the same row 
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a- 

y 


t 

c 

Sum 

Check 


470 

—316 

—407 

253 

—521 

—510 



298 

—482 

—395 

242 

—720 

—1059 



3C4 

—421 

—043 

342 

—634 

—992 



282 

—286 

—31.5 

448 

—200 

—137 


(a,) 

1 

—0.80.027 

— 0.85084 

0.53204 

—1.09085 

-1.08032 

—1.0803 

(«,) 

1 

—1.0284 

—1.334.5 

0.81758 

—2.4324 

—3.5777 

—3.5778 

(o,) 

I 

— I.l.iOO 

— 1 .700.5 

0.939.58 

—1.7418 

— 2.7253 

—2.7252 

(0.) 

1 

—1.0142 

—1.1170 

1..5887 

—0.94326 

—0.4858 

—0.4858 



—0.9031 

—0.4777 

0.28494 

—1.3350 

—2.4915 

—2.4914 



—0.4913 

—0.9097 

0.40094 

—0.0450 

—1.6391 

—1.6390 

(O.)-(Ol) 


— 0..3489 

—0.2002 

1.0.50 1 

0.15359 

0.0006 

0.6005 

(I-.) 


1 

0.49001 

—0.29580 

1.3808 

2.5869 

2.5809 

(6>) 


1 

1.8510 

—0.82828 

1.31284 

3.3301 

3.3302 

(6.) 


I 

0.74578 

—3.0209 

—0.44021 

—1.7213 

—1.7214 

(6,)-(6,) 



1.3.5.50 

—0.53242 

—0.0740 

0.7492 

0.7492 




0.24977 

—2.7310 

—1.8270 

—4.3082 

-^.3082 

(c,) 



1 

—0.39270 

—0.05459 

0.5.5205 

0.5526' 

<o,) 



1 

—10.934 

—7.3148 

—17.249 

—17.249 

(C|)-(Cl) 




—10.541 

—7 .2002 

—17.801 

—17.802 

Having reduced the 

given system to the 

single equation 



WP find 


— 10.5411 — 7.2602 = 0. 


(= — 0.68877. 


Now substituting this value of ( into (c,), we have 


whence 


2 — 0.39276 (—0.68877) —0.05459 = 0, 


2 = — 0.21593. 


On substituting into (5,) the.se values of I and z, we find 


y = — 1.4835. 

Tiien the.se known value.s are substituted into (a,) to find 

3- = 0.291 77. 


.^.s a final cheek we substitute the above values of x, y, z, and ( into the 
original equations and find that the left members become 520.99, 720.01, 
634.02, and 266.02. respectively. The discrepancies are thus only — 0.01 
0.01, 0.02, and 0.02. respectively. * ’ 
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95 The Method of Gauss. In the Gauss method of soIviDg simul 
taneous linear equations, as explained in detail and with great clarity by 
Encke,* the unknowns are eliminated auccMsively by solving some equation 
for one unknown in terms of alt the others, then substituting this value 
for the aame unknown in all the remaining equations, thereby eliminating 
the unknown from the set The process is repeated on the new set of 
equations, thus eliminating another unknown, and so on until the system 
18 reduced to a single equation in one unknown 

The equations which express one unknown explicitly in terms of all the 
others are called pivotal tqvattons After one unknown has been found, 
the remaining unknowns are found by back substitution into the pivotal 
equations 

In the solution of numerical e quations by Gauss’s method, one shou ld 
al'^ya s elect as pivotal equation the eouation which ha» the larpt st coeffi 
cieiTt or~tfae-ttnkrro Wn ~lt~ is di^ired to eliminate For eiampl e,_lf the 
unknowns are to be elemi nated in the order z, y s, (or Xi, 1%, the first 
pivotal equlition is obtained by solving for x that equation which has the 
largest ^-coefficient Then the second pivotal equation » obtained by 
solving for y that equation (in the ne» set) which has the largest y-coefS 
cient, etc \ slightly better result may be obtained by disregarding the 
order of elimination and eolviog, at each step in the elimination process, 
the equation in which the largest coefficient in the entire set occurs, this 
equation being solved for the unknown to which the largest coefficient is 
attached The reason for prefernng the largest coefficients will appear 
later The following example illustrates the Gauss method 

ExampU Solve the following set of equations by Gauss’s method, 
assuming that the coefficient! and known terms are exact numbers 

(1) 263j + 521y— 1 69^*^-0938< — 423 =0 

(2) 3 I6j— 2 95y + 0 813z — 4 2I< +0716 = 0 

(3) 53GJ-+ 1 88jf — 2 I5t —4951 —1 28 =0 

(4) 134f + 2 08y — 0 432*— I 768< — 0419 = 0 


Solution The variables will be eliminated in the order z, y, x, t Since 
the largest coefficient of z occurs in (3), we take that as the pivotal equa- 
tion Solving it for z, we get , 


( 5 ) 


1 88 , 2 13 

536 ^*^ 536 * 


4 95 I 28 
536**^ 536 


= — 0 350746y + 0 401119* + 0 923506< + 0 238806 


n/ 


BerUner Ailrof 


ichcf Jthrtue* lass, pp 2S7 272 , I83S pp 254-2S9 
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Substituting this value of a: into fl), (2), and (4), and reducing, we get 

(6) 4.287538y — 0.63906z -l-3.36682t — 3.601940 = 0 

( 7 ) — 4.05836t/ -f2.08054z — 1.29172< +1.470627 = 0 

(8) 2.510000y + 0.1055002— 0.530500t — 0.099000 = 0. 

Since (6) has the largest y-coefficient, we solve it for y and get 

(9) y = 0.1490512 — 0.785258< + 0.840096. . 

Substituting this value of y into (7) and (8), we get 

(10) 1.475642 +1.89514< — 1.93879. = 0 

(11) 0.4796182 — 2.501500/ + 2.00964 = 0.' 

Here we take (10) as the pivotal equation and get / 

(12) 2 = — 1.28428/ + 1.31386. 

Substituting this value of z into (11), we get the final equation 

(13) —3.11 7463/ + 2.63979 = 0, 
from which / = 0.846775. 

The values of z, y, and x are found by back substitution into (12), (9), 
and (5), respectively. Substituting the value of / into (12), we find 

2 = 0.22636. 

Then substituting the values of / and z into (9), we find 

y = 0.208898. 

Finally, on substituting the values of /, 2 , and y into (5), we get 

1 = 1.038335. 

The solution of the given system of equations is thus 

X = 1.038335 
y = 0.208898 

2 = 0.22636 

/ = 0.846775. ■ 

^IVlien these v.alues are substituted into the original equations (1), (2), 
('^>)> (4), the left members of those equations have the values 0.00000. 
0.00000, 0.00001, 0.00000, respectively. 
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It vill be observed that the Gaa«s method reduced the original ejgtea 
ot equations to the triaugulat sjatem of pivotal equations 

536x + 1 88y —2 15* — 4 95t —138 = 0 

4 287538y — 0 63906* + 3 36682t —3 601940 = 0 
1 47564* + ! 89514i~l 93897 =0 
— 3U 7463t + 2 63979 =0 

Since the value of the determinant of the coefhcients in the given system 
IS equal to the product of the leading coefTicients in the triangular system 
( \rt 92), we haie 

A = (5 36) (4 287538) (1 47564) (—3 117463) = — 105 720 

96 Another Version of the Gauss Method. If we apply the method 
of the previous article to the equations 


<i.r + <iy + o,t = ir, 

fa) 

M+bty + b»**sir, 

(b) 

<,i + eiy + c,t = k» 

(c) 


and assume that Oi is larger than either 6, or c„ we take (a) as the pivotal 
iquation and solve it for obtaining 



On substituting this into (b) and (c), we get 




L Oi «» ffi 


Equations (2) arc exactly what would have been obtained if we had 
multiplied (1) (a) successively by ^ and ~ and then subtracted the 
resulting equations from (1) (b) and (1) (c), respectively Equations (2) 
W -iW.awAd V. ‘A.v'wagh/vjA Isy ‘Jjah. 

multiply the resulting equation successively by b-i and C), and then subtract 
the«e resulting equations from (1) (b) and (1) (c), respectively The 
Gauss method is therefore equivalent to either of (he following procedures* 
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1. ChoosR the pivotal equation just as in Art. 95. Multiply this pivotal 
equation succcssi%’ely by such positive numbers as will make its leading 
coefTicient in each case numerically equal to the leading coefficients of the 
other equations of the set. Then subtract the multiplied pivotal equations 
from the other equations having the same leading coefficients, thereby 
eliminating one unknown completely. Follow the same procedure with 
the new equations in n — 1 unknowns. Or: 

2. Divide the pivotal equation throughout by its leading coefficient. 
Then multiply the resulting equation succe.ssively by the leading coefficients 
of the other equations and subtract the multiplied pivotal equations from 
the other equations having the same leading coeffieients. Follow the same 
procedure with the new set in u — 1 unknowns. 

In case the leading coefficients in some of the other equations are negative 
(or have signs opposite that of the leading coefficient of the pivotal equa- 
tion), the multiplied pivotal equations are added to the other equations 
instead of subtracted from them. 


Example. Solve the equations 

'2.63j-}-5.2lt/ — 1.694r-f 0.938( — 4.23 =0 (a) 

(At 3.16/ — 2.95y4-0.813z — 4.21( 4-0.716 = 0 (b) 

' 5.36/4 1.88y — 2.152 — 4.95( —1.28 =0 (c) 

1.34/ 4 2.98y — 0.4322 — 1.768/ — 0.419 = 0 (d) 

by the first method stated above. 


SoluUon. \’te take (c) as the pivotal equation and multiply it suces 
. , , 2.63 3.16 1.34 

Biveiy oy ^ ^ and thereby obtaining the equations 


(B) 


2.63/ 4 0.92246y — 1 .05494/ — 2.42882/ — 0.62806 = 0 
3.16x 4 1.10836jf — 1.26754r — 2.91828/ — 0.754627 = 0 
1 .34/ 4 0.47000y — 0.537502 — 1 .23750/ — 0.32000 = 0 


Now subtracting the first of these equations from (a), the .second from 
and the third from (d), we get 


(b), 


(C) 


4.28754y — 0.639062 4 3.36682/ — 3.60194 = 0 

— 4.05830y 4 2.08054r — 1.29172/ 4 1,47063 = 0 
2.51000y 4 O.IO 55 O 2 — 0.53050/ — 0.09900 =0 


These equations arc the same as (6). (7), (8) of Art. 95. 
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The computation u usuall; presented in tabular form as given belov 


t k 


Check 


2 63 —1694 

SIS —OSS 0813 

5A8 148 —2 IS 

1 34 8S8 —0432 


0 939 —4 23 2454 

—4 21 0 71S —2 471 

— 40S —149 —114 

—1708 —0 419 —1701 


4 28T&4 —003900 3 30082 —300194 3 41330 3 4133T 

— <05830 2 08054 -129172 I 47003 — 1 T9891 —179891 

241000 0 10550 —043050 —0 09900 1 08S00 1 69600 


1 47664 1 89S14 —1 63879 1 43199 1 43200 

047662 —240)50 2 00984 —001224 —001224 


—3 11747 2 63979 —0 47768 —0 47757 


From the last equation ve find 


2 63979 
^"311747 


= 0 846773 


Back aubslitutiOD into the other pivotal equations gives 


< = 022637 
y = 0208901 
r = l03834 

When these values are substituted into the given equations, the left members 
of those equations become 0 00001, 0 00000« 0 00000, and 0 OOOOl, respec 
lively The slight discrepancies between the results found above and those 
found in Art 9S are due to the fact that some of the numbers in the 
above table were rounded off to the same number of decimal places as 
some other numbers to which they had to be added to obtain the ‘‘sums” 
The numbers in the check column were obtained from the “ rama ” found 
m the preceding sets of equations, by applying to those sums the same 
operations as were applied to the pivotal equations For eiample, the 
check numbers 1 43200 and —0 01224 were obtained as follows 


— 1 79891 + 4^8754 ^ ^ ^ 

1 98600 — X 3 41336 = — 0 01224 

In case a check number fails to agree with the sum immediately to the 
left of it a mistake has been made in the computation and should be 
found and corrected at once 
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If fre wished to solve the given set of equations by the second method 
outlined above, we would first divide equation (c) throughout by 6.36, 
thereby obtaining the pivotal equation, 

X -f 0.350T46y — 0.401119j — 0.923507t ~ 0.238806 = 0. 

Then we would multiply this equation successively by 2.63, 3.16, and 1.34. 
The resulting equations would then be subtracted from (a), (b), and (d), 
respectively, thus obtaining equations which should agree with equations 
(C). The solution would be continued by dividing the first of the new 
equations throughout by 4.28754 to get a new pivotal equation, etc. After 
finding i, we would find the other unknowns by back substitution into the 
pivotal equations. As a final step, we would substitute the computed values 
of X, y, 2 , and i into equations (A) as a check. 

We may now state the reason for choosing as pivotal equations those 
equations having the largest coefficients of the unknowns we desire to 
eliminate. A glance at equations (2) shows that fractional terms are 
present in the coefficients and in the constant terms. It is desirable that 
such fractional terms be as small as possible, and this necessitates that the 
denominator a, be as large as possible. Moreover, if the numerators of 
such fractions contain rounding errors, the effects of such errors are 
diminished when the denominator a, is large. 


lU. SOLUTION BY INVERSION OF MATRICES 

97. Definitions. A matrix is a rectangular array of quantities or 
numbers, such as 

Oia-aja, 

61626364 i 

C1C2C3C4. 


To distinguish such an array from a determinant, which it resembles in 
appearance, it is always enclosed by square brackets, large parentheses, or 
double bars, as: 


aiOjOja, 

6,6-6364 

. 1 

fa^a~aia^\ 

63626364 j, or 

II 

11 

CiCjCjC^ 


^ CJC2C3C4/ 

CJC2C3C4 11 


We shall use the square-bracket notation and write a general matrix in 
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OiiaiiaM Oft 

atxOr^u a„ 

a.ia.id., 0.. 


The quantities a,]> ^iii called the elements of the matrix, as la 

the case of determinants It la to be noted that the first digit in the 
double subscript of an element denotes the row and the second digit 
denotes the column m which the element stands A matrix of m rows 
and n columns is an m X n matrix 

If m = n, the matrix la a square matrix of order n 


A matrix may consist of only a single column, as I 


in which case it is called a column matrix It is merely a special case of 
a general matrix 

If all the elements m the leading diagonal o! a square matrix are uai^ 
and all the other elements are mroa, the matrix is called a vntt matrix 
Thus, 

ri 0 0 0 " 

0 10 0 
0 0 10 
_0 0 0 1_ 

is a unit matrix of the fourth order A unit matrix of any order will be 
denoted by the symbol I Unit matrices play an important role m the 
application of matrices ^ 

If all the elements of a matnx are zero, the matrix itself ii zero 
Although the elements of a matrix are numbers, the matnx itself is not 
a number It plays the role of an openilor, as we shall see later 

98 Addition and Subtraction of Matrices. Two matrices of the 
same order can be added or eubstracted by adding or subtracting their 
corresponding elements Thus, the sum of the two matrices 


A = 


OiiUitOii 

OllUljOu 

.OllOuffM 


] 


and B = 


hllhihx 

6„6„6„ 
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is the matrix 


r 1 

a,, -f 6ii a ,2 + ii 2 

Ujs ri" ^33 

(7 = 

a-.i -h 5-1 a-i -1- bzz 

fl23 4" ^23 


On + ^31 ^32 + ^32 

033 4" ^33 

We therefore write 

A + B = C. ■ 



The difference of two matrices is found in the same manner, and we 
therefore write 

A—B = C/, 


where the elements of C' are those of 0 with the signs of the Vs, changed. 
Examples: 


1-2 3-4-] 

[_5 —1 0 

4- 

' 1 — 2 4"’ 
_3 5 2_ 

= 

1 1 

CO CO 

o 

1 I 


“3 —2 5" 


"2 3 — l“ 


1 — 5 6 

6 0 3 

1 5 4 


4 10 

5 2 — 1_ 

—— 

2—1 3 

— 4 3 5 


99. Multiplication of Matrices, a) MuUipUcaiion of a matrix by a 
simple number or scalar. To multiply a matrix by a number or scalar 
quantity, we multiply every element of the matrix by that number. For 
example, 

niOj ruaj mos 
mhi mbz mbz 


m 


aiajOj 

bibzbz 


To see the reason for this rule of multiplication, let us consider the sum 
of three matrices of the second order. 


.4 + B + C = 


fliiUi: 


biibiz 

bzibz 


CijCji 


Let us suppose now that the three matrices become identical, so that 
B ~C ~ A and br, — c,, = a,,. Then we have 


3(ij,3a,i 

3A = , 

_3a3i3a.; 

and .so in general. 

Note that this multiplication differs from the multiplication of a deter- 
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minant by a scalar, for in the latter case the elements of only one tow or 
column are multiplied by the scalar 

h) AfulUphcolton of a matnx by another matnx In the system of 
<'quations 

f OiT, + tttXt + aa, = k, 


( 1 ) 


+ bA + b.x, = ir- 


CiXi + (tTt + eat = k. 


the array 




C|C c, 

IS called the matrir of Ike cofffictenls This matrix may be regarded as 
an operatoi which operates on the r’e to produce the h’a on the right aide 
of the equations The operation la seen to be a type of multiplication 
If the x’a be arranged m a rertieal column, as 
*1 


x». 

the left member of the drat equation of (1) is <een to be the sum of the 
products of the elements of the top row of the coefficient matrix by the 
corresponding t't in the Tertical column The left members of the other 
equations can be obtained in the same manner We are therefore justified 
in writing (1) in the form 




~T,' 


r*'! 

(2) 

b.bjb 

X, 

.x,_ 

= 



With fS) as a starting point »e utilize a linear transformation to derire 
the rule for the multiplication of matrices in general 
Consider the two systems of equations 

(3) 


*1 = blip. + b.jr* r 
** = bjipi + bnjf* or 
= 6j,yi + 



fyi = UnXi+aiiXj + a,»r3 runOna,,"] 

\y> — ®j»x, 4" -}- fljjTs, L^*J 


( 4 ) 
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Eliminating t/i and y. by substituting in ( 4 ) their values as given m ( 3 ), 
we get 

2, = (bjja„ -}- + (buOii + ^12^22)^^ 4 * (bnOia + bi 2 a 23 )x 3 

2, = (621011 4 * ^ 22 <^ 2 \)Xl 4 - (621012 4 " iz 2 (^ 22 )X 2 4 " (621O13 4 " ^22^23)^3 
23 =r (63,0,1 4 “ 632021)0:1 4 " (631012 4 * 632022)0:2 4 " (631O13 4 " ^32^23)^3 } 

or, in matrix form. 


( 6 ) 


Now replacing the column matrix 
( 3 ), we gel 

6116,2 

(^) 


~ 6,10,, 4 " 6,3021 6iifli2 4 " 6,2fl22 61,0,3 4 " 6,3023 

Xi 


~ Zi ~ 

631O1, 4 ” 63302, 62,012 4“ 622O32 6310,3 4" 633033 

X . 

= 

22 

631O11 4" 633031 631012 4 " 633022 63,013 -j- 633033 _ 

- 




1/1 

1/2 


of (4) by its value as given in 


63,632 

[_ 63,633 J 


0,ifli«0is 

021023023 


O'! 

12 

0:3 


2l 

02 


Comparison of the left members of (6) and (T) gives the relation 

i^ll6,2 


( 8 ) 


631632 

L^si^sj J 


0 ,, 0 , 30,3 
03,033033 

611O11 4 " 6 , 303 , 
63,0,1 4 " 632O31 
, 63,0,1 4 " 632O3, 


6iiO,2 4 " 612O22 61,0,3 4 " 6,2023 

621O12 4 “ 623O22 621O13 4 * 622O33 

63,0,2 4“ 632O32 63,0,3 4* 632033 


Formula (8) expresses the rule for the multiplication of matrices. If 
the first of the two matrices in the left member of (8) be denoted by B 
and the second by A, a glance at (8) shows that the elements in the 
product matrix in the right member can be obtained by following the 
procedure outlined below. It is best to compute the product by columns; 
that is, compute one column at a time, beginning with the first. 

First column of product; 

To find the first element in the first column of the product, multiply the 
elements in the first row of B into the corresponding elements in the first 
column of A and sum the products thus obtained. To find the second 
element in the first column of the product, multiply the elements in the 
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stconi row of B into the corresponding elements in the first column of A 
and sum the products thus obtained The lAtrd element in the first column 
of the product is found b} multipljing the elements in the third rote of B 
into the corresponding elements in the first column of A, and so on for 
the remaining elements in the first column of the product 


Second column of product 

To find the first element in the second column of the product matrix, 
multiply the elements in the first row ot B into the corresponding elements 
in the second column of A and sum the products thus obtained To find 
the second element in the second column of the product, multiply the 
elements in the second rou of B into the corresponding elements in the 
second column of A and sum the products thus obtained The remaining 
elements in the second column of the product are found tn a similar 
manner 


Third column of product 

Proceed as for first and second columns, except that the elements is 
the rows of B must be multiplied into the corresponding elements m the 
third column of A 


Etample 



-3(-S) + I(J) + 2(4) 

l) + 2(3) + 3t*> 

.*(-2)+ (-3)3 + 7(4) 


3(4)+I(-J) + 2(I) 
(-l>4 + *(-l> + 8(t> 

2(4) + (-»)(— I) + T(I) 


3(I>+l{2) + 2(3) - 

(— \>\ + 2(2> + 3(S) 
2(l) + (— 5|i +7(3) 



Not« that in matrix multiplication 


(a) Kows ate always multiplied into columns 

(b) The number of rows m the product is the same as the number of 
rows in B, and the number of columns m the product is the same 
as the number of columns in A 

(c) The number of rows in one factor must be the same as the number 
of columns in the other facdor 
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Aiit. D9J iT* c/ A. ^ ' w - 

If A and B denote any two matrices and C denotes the product AB, 
then 

AB — C. 

But BA ^ C, in general. 

That is, matrix multiplication is nol commuiativc in general. For 
example, 


p 3"lr 1 4~i r— 7 2- 

Ls — lJl_-3 — 2j = L 8 22_ 

r 1 4'ip 3lr 22 — 1 
|__3 — 2 JL 5 — 16 —7 


an entirely different result. 

An important exception occurs in the case of the product of any matrix 
by a unit matrix. For e.xample, 

“0,0,03 “iri 0 0“ 

h,bA}, 0 1 0 


. CiCjCa J[_0 0 Ij 

0 1 “f“ 3 3 3 "t" ^2 “1“ H 

= 6, + 0 + 0 O + &2 + O 

_c, + 0 + 0 O + C 2 + O 


0 + 0 + flj 
0 + 0 + 

0 + 0 + c, 


0,0,03 


“1 0 onroiOjOj” 

010 6,6jb, 

_0 0 1 J _ CjCjCj _ 

'i>*l '0 + 0 Oj + O + O 03 + 0 + 0 “ “0,0,03 

O + ^I + O 0 + 62 + 0 0 + 63 + 0 =: 6,6263 

0 + 0+ r, 0 + O + C2 0 + 0 + C3_ _ CiCjC, 

which is the same result in both cases. 

It is to be noted that Ihe multipUcaiion of a mofrtx by a unit matrix 
docs not change Us value. More generally, 

AI = AP = - - • = AP — A. 

In the product AB—C. B is said to be premultiplied by A ; whereas in 
the product BA = D,B is said to be pos/multiplied by A. Because matrix 
multiplication is not commutative in general, premuitiplication and post- 
multiplication do not give the same result in general. 
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The Bju\tjpl»cal»on of one metnx by anothet is t. most impoitant process 
snd should be thoroughly learned and kept m mind by everybody who verb 
with matrices It is used constantly iii checking the inversion of matrices 


100 Inversion of Matrices. The operation of dividing one matrix 
directly b} another does not exist in matrix theory, but the equivalent of 
division can be accomplished in most casea bv a process railed the inversion 
of matrices The inverae of a square matrix A is another square matrix 
A ‘ of the same order such that 
(1) AA‘ = /, 


where I denotes a unit matrix of the same order 
shown that 

A M=; 

so that 


AA * = A 'A 


Xforeover, it can be 


Hence a matrix is commutative with its inverse The process of finding 
A ' when A is given is called the inversion of A Before showing how to 
find A * we digress for a moment to consider the condition necessary for 
its existence 

If A denotes any square matrix such as 



I 1 


IS called the determinant of the matrix If the determinant of a matru 
18 not zero the matrix is said to be non smgular and can always be inverted 
That IS if I I 96 0 A ' can alwap be found The reason for this is 
as follows 

It is shown ID most books dealing with matrix theory that 




' Ai 

R1 



Lw 


B, 


w 

B, 

PI 
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vrhere A^, B;, etc., are the cotactors of the elements Ci, etc., in the 
determinant [ A |. Evidentlj' A~^ could not exist if | A | = 0. 

Several methods have been devised for finding the inverse of a matrix. 
It can be found, for example, by means of formula (2). Although (2) 
is of value theoretically, it is of little value in the inversion of numerical 
matrices, because of the large number of determinants (the cofactors) 
that must be evaluated. The method of inversion explained below is 
simple, direct, and reasonably short. By a procedure similar to the Gauss 
method explained in Art. 96, the given matrix is transformed into its 
inverse by means of a unit matrix of the same order. The transformation 
is made in consecutive steps, the number of steps being equal to the order 
of the matrix. A single column of the unit matrix is used in each step. 
The aim in each step is to reduce to zero all the elements in the first 
column except one, and that element is reduced to unity by dividing its 
row throughout by such a number as will make it unitj’. The matrix at 
the beginning of each step is augmented by the appropriate column of the 
unit matrix, and all elements in each row of the augmented matrix are 
subjected to the same operations. The underlying theory of this method 
of inverting matrices will not he given. The fact that the method always 
gives the correct result is a sufficient indication of its soundness. The 
simplest case of the method and a more general case will be explained by 
means of examples. The first element in the pivot line of every matrix 
will be in bold type. 

o) The simplbit case. 

Example 1. Find the inverse of the matrix 


A = 





Solution. The given matrix is first augmented by inserting the first 
column of a unit matrix of the third order, as follows: 




«!OLUTION OF SmULT\NEOU8 LINEAU EQUATIONS (Ch4p MI 


2SI 

The first row is then divided throughout by 2, giving 
" I — 1 2 ; 1/2" 

2 3 2 ; 0 

— 2 1 —2 J 0 _ 

\V e now multiply the first row by 2 and subtract the result from the second 
row, and we nl°o add the first row to the third row, thereby obtaining 
"l _1 2 I 1/2 " 

0 5 — 2 ; — I 

0 0 1 : l/^_ 

This ends the first step of the transformation 
To start on the second step, we discard the first column of the otd 
matrix and augment the last three columns by the second column of the 
unit matrix Thus 

(■ — 1 2 1/2 ; o" 

I 5 — 2 — 1 • I 

(_ 0 1 1/2 J 0_ 

We DOW divide the second row throughout by 5 and add the result to the 
first row, thus obtaining 

‘O 8/5 3/10 ; 1/5' 

1 —2/5 —1/5 ; l/o 

0 1 1/2 ; 0 

This ends the second step Note that nothing was done to the third row, 
because its element in the first column was already 0 
We begin the third and last step of the transformation by discarding the 
first column of the matrix just found and then augmenting the remammg 
columns by the third column of the unit matrix Then we have 

8/5 3/10 1/6 ; o" 

—2/5 —1/5 1/5 ; 0 

1 1/2 <5 ! 1 _ 

Now multiply the third row by 8/5 and subtract the result from the first 
row, and also multiply the third row by 2/5 and add the result to the 
second row This gives 

To — 1/2 1/5 ; — 8/5 "1 
0 01/5' 2/0 


1 1/2 
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This ends the third step of the transformation, 
column of the matrix just obtained, we have 

" — 1/2 1/0 — 8/5~ 

0 1/5 2/5 . 

1/2 0 1 


On dropping the first 


as the inverse of the given matrix. 

Since misUtes are easily made in the transformations, we check the 
result by seeing wliether the inverse premultiplied by the given matrix- 
gives the unit matri.x. We therefore have 


“ 2 

— 2 

4 " 


--1/2 

1/5 

— 8/5“ 

2 

3 

2 

X 

0 

1/5 

2/5 

_— 1 

1 

— 1 _ 


1/2 

0 

1 



“—1+0+ 2 

2/5 — 2/5 + 0 

— 16/5— 4/5+4"! 


|“1 0 0“ 


— 1+0+ 1 

2/5 +0/5+0 

—16/5+0/5 + 2 ' 


0 10 


_ 1/2 +0 — 1/2 • 

— 1/5 + 1/5 + 0 

8/5 + 2/5 — ij 


_0 0 1 _ 


The inverse found is therefore correct. 


Example 2. Find the inverse of the matrix 
“ 2—2 0 — 1 “ 

0 2 12 

1—2 3—2 
0 12 2 


Solution. The steps in the solution are shown below. 



“2 

2 

0 -1 ; 1-] 


“1 

— 

1 0 - 

-1/2 ; 

1/2 -] 




0 

2 

1 2 ; 0 


0 


2 1 

2 ' 

0 




1 

0 

3 —2 1 0 


1 

— 

2 3 

— 2 '' 

0 

• 



0 

1 

2 2 ; 0 


0 


1 2 

t 

2 ' 

1 

0 



Subtract 

row 1 

from row 3. 

Then 

Ave 

have 






“1 

— 1 

0 —1/2 ; 

1/2“ 








0 

2 

1 2 ; 


3 








0 

— 1 

3 -3/2 ; - 

-1/2 

End of 

step 1 





0 

1 

2 2 ' 

t 


3 









•1 0 

— 1/2 1/2 ; 

0" 


“— 1 

0 — 

■1/2 

1/2 ; 

0 “ 



2 1 

2 0 

1 

1 


1 

1/2 

1 

0 ' 

1/2 



-1 3 

— 3/2 — 1/2 J 

0 


— 1 

3 — 

3/2 - 

-1/2 ; 

0 


- 

1 2 

2 0 

1 

1 



- ^ 

2 

‘1 

0 ' 

1 

0 



2S6 SOLUTION OF SIMULTANEOUS LINEAR EQUATIONS (CH*f XII 

Add row 2 to rows 1 and 3 and subtract it from row 4, obtaining 


"0 1/2 1/2 1/2 
11/21 0 

0 7/2— 1/2— 1/2 
03/21 0 


1/2” 

1/2 

1/2 


End of step 2 


— 1/2 


ri/2 

1/2 

1/2 

1/2 1 0* 


■1/2 

1/2 

1/2 

1/2 ; 

1/2 

1 

0 

1/2 • 0 


1/2 

1 

0 

1/2 ; 

7/2 

-1/2 

-1/2 

1/2 ; 1 



— 1/14 

— 1/14 

1/14 ■ 

3/2 

1 

0 

— 1/2 ; o_ 


3/2 

1 

0 — 

1/2 1 


Subtract row 3 from rows 1 and 2, and subtract three times row 3 from 


End of step 3 


The result 

s 




0 4/7 

4/7 3/7 ; 

-ini 


0 15/U 

1/14 3/7 ; 

-1/7 


M -I/H 

-1/14 1/H ; 

1/7 


0 17/14 

3/14 -5/7 ; 

— 3/7_ 



fO 4/7 4/7 

3/7 

: -i/r" 


0 15/14 1/14 

3/7 

: -1/7 


1 -1/7 -1/7 

1/7 

: 2/7 


0 17/14 3/14 

-5/7 

I —3/7. 

4/7 4/r 3/7— 1/7; 

0" 



15/14 1/14 3/7— 1/7; 

0 



— 1/7— 1/7 1/7 2/7; 

0 



17/14 3/14 —5/7 —3/7 ; 

1 




■ 4/7 4/7 

3/7 

-1/7 ; 


15/14 1/14 

3/7 

-1/7 ; 


— 1/7 — 1/7 

1/7 

2/7 ; 


1 3/17 - 

-10/17 

— 6/17 ; 


Multiply row 4 bjr 4/T and subtract result from row 2, multiply row 4 
by 15/14 and subtract the result from row 3, and multiply row 4 by 1/7 
and add the result to row 3 The result is 

'0 8/17 13/17 1/17 ; —8/17" 

0 —2/17 18/17 4/17 J —15/17 

0 —2/17 1/17 4/47 ; 2/17 

1 3/17 —10/17 —6/17 I 14/17_ 


End of step 4 
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Hence 


~ 8/17 

13/17 

1/17 

—8/17" 

" 

— 2/17 

18/17 

4/17 

— 15/17 

= 1/17 • 

— 2/17 

1/17 

4/17 

2/17 

3/17 - 

-10/17 

— 6/17 

14/17 

L 


13 

1 

— 8 

18 

4 ■ 

— 15 

1 

4 

2 

— 10 - 

-6 

14 


is the desired inverse matrix. Premultiplication of this by the given 
matrix will give a unit matrix of the fourth order, as the reader may verify. 


Example S. Invert the matrix 


"1.254 

0.831 

1.109 

0.532 

1.105 

0.702 

_0.957 

1.342 

0.642 


SohiitoJi. We have 


"1.254 

0.831 

1.109 

! 11 


"1 

0.6627 

0.8844 

' 0.7974" 

0.532 

1.105 

0.702 

! 0 

= 

0.532 

1.105 

0.702 

'' 0 
t 

_0.957 

1.342 

0.642 

: 


0.957 

1.342 

0.642 

1 ^ 


where we have divided row 1 by 1.254. Now multiply row 1 of the matrix 
on the right by 0.532 and subtract the result from row 2, and also multiply 
row 1 by 0.057 and subtract the result from row 3. We thus get 


1 0.6627 
0 0.7524 
0 0.7078 


0.8844 

0.2315 

-0.2044 


0.7974 ■ 
-0.4242 
-0.7631 


0.6627 0.8844 

0.7524 0.2315 

0.7078 —0.2044 


0.7974 ; O' 
-0.4242 ; 1 
-0.7631 ' 0 


End of step 1 



"0.6G27 

0.8844 

0.7974 

0 


1 

0.3077 

— 0.5638 

1.3291 


0.7078 

— 0.2044 

— 0.7631 

0 


Now multiply row 2 by 0.6627 and subtract result from row 1. Also 
multiply row 2 by 0.7078 and subtract result from row 3. Then we have 
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[ 0 0 6805 imo 1 —0 88081 

1 0 30rr —0 5638 I 13291 

0 —04217 —03640 ; — 09407J 

0 8808 ; ©1 
1 3291 ; 0 I 
0 9407 ; ij 


End of etep 2 


0 6805 1 1710 — 

0 3077 —0 5638 
-04217 — 03G40 


=[ 


06805 11710 —08808 J 

0 3077 —0 5638 1 3201 | 

1 08632 2 2303 ; 



On multiplying row 3 by 0 6805 aud 0 3077 and subtracting the respectire 
results from rows 1 and 2, we get 

[ 0 0 5836 —2 3988 J 1 614 1 

0 —0 8294 0 6427 | 0 7297 End of step 3 

1 0 8632 2 2308 I — 23 TI 4 J 

The r«<}y\red jivveree « therefore 

0 5836 — 2 3988 1 6H ' 

— 0 8294 06427 0 7297 

0 8632 2 2308 —2 3714. 


When this is premultiplied by the given matrix, the result is 
0 9997 0 0000 0 0006* 

— 0 0001 1 0001 0 0002 , 

— 00005 — 0 0009 1 0014_ 
which 18 practically a unit matrix 

6) IniersKn »n iht more ^enernf case In the preceding examples the 
pivot lines have been taken in consecutive order, always bgmnmg with 
the first line of the given matrix This procedure cannot be followed if 
the first element in the pivotal line is zero Furthermore, if the first 
element m the pivotal line is not zero, it is sometimes desirable to take 
pivotal lines m any order However, when the pivotal lines are not taken 
in consecutive order, the matrix obtained at the end of the last step will 
not be the desired inverse, but will be that inverse with its rows and 
columns permuted The matrix obtained in the last step must therefore 
be unscrambled to obtain the desired inverse The unscrambling process 
will be explained by means of an example 
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Example J/. 


Find the inverse of the niatri.v 


“1 —2 3 4" 

3 —1 2 5 

2 4 —5 ] 

4 2—13 


Solution. Here we take as pivotal row the one having the largest element 
in the first column : the fourth row. Augmenting the given matrix by the 
fourth column of a unit matrix of the fourth order, we have 


"1 

— 2 

3 

4 

0“ 


1 

L_ 

3 

4 

0 “ 

3 

— 1 

2 

5 

0 


3 —1 

0 

0 

0 

O 

Ki 

4 

— 5 

1 

0 


2 

4 

— 5 

1 

0 

_4 

2 

— 1 

3 

1 _ 


_1 

1/2 

-1/4 

3/4 

1/4 


Subtracting row 4 from row 1, three times row 4 from row 2, and twice 
row 4 from row 3, we get 


"0—5/2 13/4 13/4 

0 —5/2 11/4 11/4 

0 3 —9/2 —1/2 

_1 1/2 —1/4 3/4 


-1/4" 
-3/4 
— 1/2 
1/4 


End of step 1 


~— 5/2 13/4 13/4 —1/4 

— 5/2 11/4 11/4 —3/4 

3 —9/2 —1/2 —1/2 

1/2 —1/4 3/4 1/4 


0 " 

0 

1 

0 


~ — 5/2 13/4 

13/4 

— 1/4 

0 " 

— 5/2 11/4 

11/4 

-3/4 

0 

1 —3/2 

-1/0 

— 1/6 

1/3 

3/2 —1/4 

3/4 

1/4 

0 


Now adding 5/2 times row 3 to rows 1 and 2, and sul.tractinf- 1/2 of 
row 3 from row 4, we get ° 


“0 

— 1/2 

17/G 

-2/3 ; 

5/G 

0 

— 1 

7/3 

-7/6 ; 

5/6 

1 

— 3/2 

— 1/G 

— 1/G ; 

1/3 

0 

1/2 

5/6 

1/3 ; 

— 1/6 


End of stop 2 
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•—1/2 17/6 <—2/3 5/6 ; O' 

— 1 7/3 —7/6 5/6 J 1 

— 3/2 —1/6 —1/6 1/3 I 0 

— 1/2 5/C 1/3— 1/6; 0, 


*—1/2 17/6—2/3 5/6 

1 —7/3 7/6 —5/6 

—3/2— 1/6— 1/6 1/3 

1/2 5/6 1/3— 1/6 


0* 

•1 

0 

0 


Adding 1/2 row 2 to row 1, 3/2 row 2 to row 3, ii>d subtracting 1/2 
row 2 from row 4 we get 


"0 5/3 —1/12 5/12 ; —1/2" 

1 —7/3 7/6 —5/6 ; —1 

0 —11/3 19/12 —11/12 ; —3/2 

0 2 —1/4 1/4 I l/2_ 


Fnd of step 3 


5/3 —1/12 5/U — 1/2 ; 1 ■ 

— 7/3 7/6 —5/6 —1 ; 0 

— 11/3 19/12 —11/12 —3/2 ; 0 


2 —1/4 

1/4 

r 1 

1/2 • 0 

— 1/20 

J 

1/4 

—3/10 

3/5’ 


-7/3 

7/6 

-5/0 

— 1 

0 


-11/3 

19/12 

— 11/12 

— 3/2 

0 


u 2 

— 1/4 

1/4 

1/2 

0 


Now add 7/3 of row 1 to row 2 and 11/3 of row I to row 3 Also subtract 
twice row 1 from row 4 Then we lave 


'1 —1/20 1/4 —3/10 , 3/5* 

0 21/20 —1/4 —17/10; 7/5 

0 7/3 0 —13/5 ; 11/5 

0 —3/20 —1/4 11/JO ; — 6/S_ 


End of step 4 


Hence the permuted inverse is 

{" — 1/20 1/4 —3/10 3/6~ 

21/20 —1/4 —17/10 7/5 

7/5 0 _l3/o 11/5 

— 3/20—1/4 11/10— 6/5_ 


(A) 
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To unscramble this matrix, vre first permute its rows and then permute 
the columns of the resultant matrix. Tn order to make the permutations 
in a systematic and infallible manner, we construct a table showing the 
pivotal row used in each step of the transformation. The table for the 
present example is: 


Steps: 1 2 3 4 (for rows) 


Pivot rows: 4 3 2 1 


(for columns). 


The use of this table is as follows: To find the rows in the first per- 
muted matrix, we fix our attention on the numbers in the iop row of the 
table and note the number directly under any particular number. For 
example, the number directly under 2 in the top row is 3, and this means 
that row 2 of the new matrix will be row 3 of the previous matrix (the 
scrambled inverse found in the last step of the transformation). 

To find the columns in the final inverse matrix, we fix our attention 
on the numbers in the bottom rota of the table and note the number directly 
over any particular number. For example, the number directly over 1 in 
the bottom row is 4, and this means that column 1 in the final matrix is 
columr. 4 of the previous matrix (the one having the unscrambled rows). 
We now proceed to unscramble (A), first unscrambling the rows. 

To find row 1 of the next matrix after (A), we look for 1 in the top 
row of the table and find that the number immediately under it is 4. 
Hence row 1 of the new matrix is row 4 of (A). Likewise, under 2 of the 
top row we find 3 and therefore row 2 of the new matrix is row 3 of (A). 
The remaining rows of the new matrix are found in the same manner 
and we therefore get the matrix 


(B) 


— 3/20 —1/4 11/10 —6/5“ 

7/5 0 —13/5 11/5 

21/20 —1/4 —17/10 7/5 

— 1/20 1/4 —3/10 3/5 


We now unscnimble the columns by applying the table to (B). To find 
column 1 of the final inverse matrix, we look for 1 in the bottom row of 
the table and find 4 immediately above it Column 1 of the inverse is 
therefore column 4 of (B). To find column 2 of the inverse, we look for 
2 m the bottom row of the table and find 3 immediately above it. Column 
2 of the inverse is therefore column 3 of (B). The remaining columns 
are found in the same manner and we thus get 
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(C) 


-_6/5 n/10 —1/4 —3/20 • 

n/5 —13/5 0 7/5 

7/5—17/10—1/4 21/20 

3/S —3/10 1/4 — 1/20_ 


as the desired inverse matrix The reader will find that if (C) be multi 
plied by the original matrix the result Till be a unit matrix of the fourth 
order That shows that (C) la the correct inverse 

The fact that the numbers of the pivotal rows were the inverse of the 
numbers of the steps ri» the above example was more or less accidental 
The third row was used as pivotal row in the second step because its first 
element, 3, was the largest of the first elements in the tmaining unused 
rows In the third step there was little choice between the first and second 
rows So we used the second row as pivot 
In further explanation of the unscrambling process, we consider the 
simple matrix 



Carrying out the inversion transformations, we 

have 

ri -2 

3 ; 01 ri —2 


® 1 

3-1 

4 ; 1 U 1 -1/3 

4/3 : 

1/3 

1 

-2 ; 0 J L2 1 

—2 ; 

0 J 


ro —5/3 

5/3 ! 

-1/31 


= 1 —1/3 

4/3 ; 

1/3 1 End of step 


[_0 5/3 — 

14/3 • 

-2/3 J 

r-6/3 

5/3 —1/3 ; 01 

r ® 

-3 -1 1 1 "1 

-1/3 

4/3 1/3*0= 

0 

2/5 —1/5 ■ 1/5 

L «/3 

— 14/3 —2/3 , ij 

L5/3- 

14/3 — 2/3 ‘ 1 J 


'0 —3 —1 ; 1 " 

0 2/5 1/5 ; 1/6 End of step 2 

1 —14/5 —2/5 ; 3/5_ 


" —3 

— 1 

^ ! n 

r * 

1/3 

— 1/3 1 

-1/3- 

2/5 

1/5 

1/5 ; 0 = 

J 2/5 

1/5 

1/5 ; 

0 

— 14/5 

— 2/5 

3/5 ; oj 

L— 14/5 

— 2/5 

3/5 ; 

0 
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(A) 


INVERSION* OF MATRICES 


'I 1/3 —1/3 
0 1/15 1/3 

0 8/15 —1/3 


-1/3 - 
2/15 


— 14/15 


End of step 3 


"1/3 —1/3 —1/3 
1/15 1/3 2/15 

8/15 —1/3 —14/15 


Permuted inverse. 


The table showing the pivotal rows for the three steps is : 

Steps: 12 3 (for rows) 

Pivot rows: 2 3 1 (for columns). 


The table shows that row 1 of the ne.\t matrix is row 2 of (A), that row 
2 is row 3 of (A), and that row 3 is row 1 of (A). Hence we have 


(B) 


1/15 1/3 2/15 
8/15 —1/3 —14/15 
1/3 —1/3 —1/3 


Now looking at the bottom row of the table, we see that column 1 of 
the inverse is column 3 of (B), that column 2 is column 1 of (B), and 
that column 3 is column 2 of (B). Hence we write 


(C) 


2/15 
— 14/15 
-1/3 


1/15 1/3 

S/15 —1/3 
1/3 —1/3 


Inverse of given matrix. 


If we multiply (C) by the given matri.x, we get 

■ 1 0 0 " 

0 10 , 

_0 0 1 _ 

which show.s that (C) i.s the desired inverse. 


The reader will note that in any step of the transformation the number 
of the augmeiilinff column from the unit rnairii must agree with the 
numbrr of the rou' used os pirot. For example, if the third row of a 
matrix is the pivotal row, the matrix must bo augmented by the third 
column of the unit matrix. 

The reader should also bear in mind that any row can be used as pivot 
cnly once in the transformation. In other words, a different row must 
be used as pivot for each stop. 
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101 Solution of Equations by Uatrlx Methods. In matrix notation 
any system of simultaneous linear equations can be represented by the 
simple equation 

(1) Ax = l, 

where A denotes the matrix of the coeHicienta, r denotes a column matrix 
of the unknown x a, and h denotes a column matrix of the known terms. 
On premultiplying (1) by *, we get 

(2) x = ^*J; 

Equation (2) girea tne aolution of the given system From this it u 
seen that m the solution of a system of linear equations by the matrix 
method, the chief problem is the inversion of the matrix of the coefficients 
After the inverse matrix has been found, all the unknowns can be found 
in one abort step A few examples will show how this is done 
Example I Solve the ayatem of equations 

{ 2x. — 2x, -r — 12 
2Xi+3x, + 2x,s=8 
— *,+ X,— x,i=T/2 
3elulion In matrix form this system is written 



The matrix of the coefficients is the «8me as Example 1 Vrt 100 wherein 
the inverse matrix was found to be 


■—1/2 1/6 —8/5' 
0 1/5 2/5 

1/20 1 _ 


Hence by (2) we have 


iT.-l 


-_l/2 

1/5 - 

- 8/5-1 

r — 12 "1 



« 

1/5 

2/5 > 

( 8 

X, __ 


L V2 

0 

1 

7/2 


On perlonning the indicated nulbplication in the right member, we get 


■fi' 


■ 6 + 8/6— 28/5" 


2 - 

ft 


0 + 8/5+ 7/5 
6+ 0 + 7/2. 


3 

.—6/2. 
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= x.=z3, 13 = — 5/2. 

Example S. Solve the system 

' x — 2y-{-3z + ii = 9/2 

3x — y -}■ + 5i = 19/3 

2x-\-iy — -5z+ < = 15 
^4x-\-2y— z + 3< = 12. 

Solution. Here we have 


"1—2 3 4 


" X 


9 / 2 - 

3—1 2 5 


y 


19/2 

i 

to 

i 1 

Or 

1 


z 

_ 


15 

_ 12 _ 


The matrix of the coefficients is seen to be the same as the matrix of 
Example 4, Art. 100, whose inverse was found to he (C). Then by (2) 
we have 


“ X 


6/5 

11/10 

— 1/4 — 3/20~ 


■ 9/2“ 


--1/2“ 

y 


11/5 

— 13/5 

0 7/5 

X 

19/2 

. . 

2 

z 


7/5 

— 17/10 

— 1/4 21/20 

15 


— 1 

_ t _ 


3/5 

— 3/10 

1/4 — 1/20 _ 


_ 12 _ 


3 


Hence 

i = — 1/2, y = 2, 2 = ^1, < = 3. 


It will be seen from the above examples that the solution of a system 
of non-homogeneous linear equations by the matrix method consists of two 
distinct operations: (1) inverting the matrix of the coefficients and (2) 
premultiplying the column matrix of the known quantities by the inverted 
matrix. 


IV. SOLUTION BY ITERATION 

102. SjTStems Solvable by Iteration. All the preceding methods of 
solving systems of linear equations involve many subtractions of terms of 
the s.amc order of magnitude. When such terms are nearly equal, their 
difference is nearly zero. The inaccuracies due to this inherent weakness 
of the methods cannot be entirely avoided. The best the computer can do 
is to treat all given quantities as exact numbers, use as many significant 
figures as practicable tl^roughout the computation, and do as little rounding 
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as possible until the final results are reached The results will then be no 
more accurate than the given quantities, and may be much less accurate 

The method of iteration eipUined in Art 81 is free from the inherent 
inaccuracy of the preceding methods Moreover, it is a self-correcting 
method, any errors made at any step in the computation are corrected in 
the subsequent iterations 

Unfortunately, hovrever, the method of iteration is not applicable to til 
systems of equations In order for iteration to succeed, each equation of 
the system must contain one large coefficient (much larger than the others 
in that equation), and the la^ coefficient must be attached to a diSereot 
unknovrn in each equation This requirement is met when the large 
coeCficienis are along the leading diagonal of the matrix of the coefficients, 
as is sometimes the care In soiring a system of equations by iteration, 
each equation is first solved for the unknown having the large coefficient, 
thereby expressing it explicitly m terms of the other unknowns Further 
steps in the process are best explained by examples 


^ Example 


I Solve the following equations by iteration 


(1) 


272 -{- 6y-~ x= 85 
6r+l5y+ 2xas 72 
x+ y + SirssllO 


Sufufion Since these equations meet the requirement for iteration, we 
solve each equation for the unknown having the large coefficient and thus 
get the system 


( 2 ) 


= + (•) 
S=L (72-61-2.) (b) 

^' = ^(110— t-j) (c) 


We start the iteration by putting y = 0, s = 0 id (2) (a), thus gelling 

»<'> = |j = 3l5- 

Now aubstitulmg I'ziS 15, i = 0 in (2) (b), we get 
y<'> = i (72 — 18 90) =z 3 54 
Then putting 2 = 3 15, y = 3 S4 in (2) (e), we get 
r<’>=:^(110 — 315— 3S4)=191 


y 
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For the second iteration we have 

xt=) = ~ (85 — 21.24 -i-IJl) =2.43 

t/(=) = -4 ( 72 — 14.58 — 3.82) =3.57 
^ lo 


(110 — 2.43 — 3.57) =1.326.^ 

54 

By continuing in this manner and denoting the succe.s.sive iterations by 
/„ etc., we get tthe following table; 



The solution of the system (1) is therefore 

x = 2.425, y = 3.573, 2 = 1.920. 

Example 2. Solve the following system by iteration: 

■ 3.122t -f- 0.575Gy — 0.1 5652 — 0.0067/ = 1.571 

0.57561 + 2.938y + 0.11032 — 0.0015/ = — 0.9275 

(3 ) J 

— 0.1565X + 0.1103y + 4.1272 + 0.2051/ = — 0.0652 

— 0.0067X — 0.00l5y + 0.20512 -f- 4.133/ = — 0.0178. 

These equations meet the requirement for iteration. Solving each for 
the unknown having the largest coefficient, we have 


( 4 ) 



(1.571 — 0.5766y -f 0.15652 + 0.0067/) 

(— 0.9275 — 0.5756i — 0.1 1 032 + 0.001 5/ ) 
(— 0.0652 -}-0.15G5x — 0.1103y — 0.2051/) 
( — 0.0178 -f- O.OOG7X -f O.OOlSy — 0.20512) 


(a) 

(b) 

(c) 

(d) 
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Putting y = 0, i sr 0, i = 0 m (a), we get 


Then putting ar = 0 503, a = 0, / = 0 in (b), we get 

(— — ® 0 503) =r— 0 414 
To find we put z=s0 503, y s= — 0 414, 1 — 0 in (c) and get 
,(t} _ (_o 0G52 + 0 1665 X 0 503 + 0 1103 X 0 414) = 0 0143 

Then for <**• we have 


<U) = (— 0 0178 + 0 0067 X 0 503 — 0 0016 X 0 414 

— 02051 X 0 0143) =*-000435 

To etart the second iteration, we substitute m (4) (a) the above valnea 
of y<‘*, s'”, and get 

*<” = 0580 

Then 

yW - [_0 9275 — (0 6766) (0 580) — {0 1103) (0 0143) 

— (0 0015) (0 00435)1 =“0 430 

The reader will note that ns soon os a neio t-afue u fomd, it u used at 
cnee in the immedtotely faUomng equatwm By continuing the iteration 
as outlined above, we get the following table 


I. 

/, 


7 , 


g J[_ 

0 503 —0 414 

0 6S0 —0 430 

0 6834 —0 4307 

0 6835 —0 4307 

0 6835 —04307 


0 0143 —0 00435 

0 0179 —0 00441 

0 01805 — 0 004413 

O0180S —0 004413 

0 01806 —0 004413 


The solution of the system (3) is thus 

* = 05836, y = — 04307, * = 001806, f = — 0004413 

After one or two iterations in an example to which the method of itera 
tion 18 applicable, the changes in the computed values of the unknowns 
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should be gradual. Erratic changes will usually mean that an error of 
some kind has been made in obtaining the erratic value, and therefore the 
value should be checked before proceeding further. 

103. Conditions for the Convergence of the Iteration Process. In Art. 
82 we derived the conditions for the convergence of the iteration process 
for a system of two equations of any nature. Those results can be 
extended to systems in any number of unknowns. For example, in the 
case of the system in four unknowns 


x = F^{T,y,z,t) 
yz=iF^{x,y,z,t) 
z = F^{x,y,z,t) 
t = F 4 x,y,z,l), 


the conditions for convergence are 




aFj 


9F, 


0F4 

dx 1 

1 + 

01 

+ 

01 

4 . 

0X 


and three similar inequalities involving partial derivatives w’ith respect to 
y, z, and t, respectively. On adding the four inequalities and grouping 
the terms of the resultant inequality in the vertical direction, we readily 
see that the latter Inequality is satisfied by the four conditions 


0F, 

01 

+ 

0F, 

9^ 

+ 

3F. 

0 z 

+ 

0F, 

0< 

3F. 

0 x 


3F- 

9y 

H- 

0F- 

02 

H- 

0F, 

0f 

0F, 

0X 


0F, 

9y 

+ 

9 F 3 

02 

+ 

dF, 

dt 

eF4 

dx 

+ 

9F, 

9y 

+ 

aF, 

02 

+ 

9 F 4 

dt 


Writing the sy.stem 


<1 

<1 

<1 

< 1 . 


OiX 4- i^y 4- c,2 4- dj = gj 
c-i 4- 4* c-iZ 4* (1,1 = e, 

n^x 4- Jjt/ 4- Cj 2 4- djf = C 3 

a^x 4- 6,y 4 - CiZ 4 - 
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II tlic iteration fonn 

1= — ^e, — — c,t — djt) 


- (e — Oj* — Cit — djf) 

• — h,y — 3it) 

F, z= (e, — Ox — l,y — c,* — dj!) 

F^ss (t,—aiX — Oy — e,t — d,t) 


Me ha\e by (1) 


Fiss — (x, — a*i — 6,y — O2 — d,0 


(e, — a,x — J,y — e,z — 0 0 


^^j-0 — —ii. £l &y» _ 

3x ” 2y ”” a, ’ ?z a, * it fli 

0 F_ ^ A 8 A _ dt 

?X ■“ J, iy ~ ' it 61 * 01 bi 

etc 

Sub tituting into (i) those laloes of the partial denvatires, we hare 

'^- +|;;'i+'-'' <l.°r|t.| + |c,| + |J.|<|.,| 

< 1 . or I I + I c. I + I * I < I s. I 

etc 


Hence for a system of linear equations the sufficient conditions for the 
conrergence of the iteration process are given by the following siniple rule 
The process of tleratton triff eoneerye xf in each equation of the system 
the alsolile talue of the largest eoe^cienl w greater than the sum of the 
absolute talues of all fJie remainuiy toeffictenls in that equation 



Abt. 104} ERRORS IX SOLUTIONS DUE TO ERRORS IN COEFFICIENTS 301 

This rule can be applied at a glance and is seen to hold for the two 
examples worked above. 

Bcmarhs. In the preceding pages several standard methods of solving 
evstems of linear equations have been explained in sufficient detail to enable 
the reader to see the advantages and disadvantages of each. No one method 
can be called the best for any and all systems of equations that may arise. 
The method of iteration is probably the best method where it is applicable, 
provided the convergence is reasonably rapid. It is the best because it is 
self- correcting and is applicable to systems of any number of unknowns. 
The best of the remaining methods are the modified Gauss method of Art. 
96 and the method by inversion of matrices (Art. 101). 

104. Errors in the Solutions when the Coefficients and Constant Terms 
are Subject to Errors. In systems of linear equations occurring in applied 
mathematics the coefficients and constant terms are often subject to errors 
due to rounding or to imcertainties in experimental data. The solutions 
obtained from such systems will therefore be inaccurate to some extent. 
It is not possible to determine the exact magnitude of the errors in the 
solutions in such cases, but it is possible to determine the upper limits of 
the magnitudes of the errors. A method of determining the upper limits 
will be explained in this article. 

Let us consider the simple system 

{ OiX + o,y -f csz = fl4 
bii -f bjy + 6,2 = 64 
Cix + Cjy -f c,r = C4, 

where the coefficients and constant terms are subject to the errors Aa, 
ia,, etc. ’ 

If the exact values of the coefficients and constant terms are Ao,, 
Ot + Aa.. etc., and the corresponding true values of x, y, and 2 are a; Ai, 
y-4-Ay, and 2 + Ac, the system (1) becomes 

' (Oi 4- Aa^){x + Ai) + (02 4- Aa,)(y 4- Ay) 4- (a, 4- Aa,)(2 4- Ac) 

= O4 4- Aa4 

(2) 4 - as) 4- (62 4- A6.)(y 4- Ay) 4- (6, 4- A6,)(2 4- Ac) 

cir ^4 Ab4 

(Ci + Ac,)(a: 4 - At) 4- (c, 4- Ac,)(y 4- Ay) 4- (c, 4- Ac,)(2 4- A2) 

= C4 4 - AC4. 
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Performing the indicated multiplications id the left hand members, ceg 
lecfing all terms containing products of errors (such ss AOiAz, etc.), and 
then subtracting the equations in (1) froin the corresponding equations 
obtained from (S), we get 

f fl, Ai + a, Ay -I- fliAa = An* — (x Aa, -f- yAo, + *Aa,) = i„ saj 
b,Ar + bjAy b»A2 = Ab4 — (TAb, + yAb* -}* *Ab,) =sfc,, “ 

C| Ar + CiAy 4- c»Ai = AC. — (lAc, -f yAt^ + * Ac,) = h„ “ 

biote that equations (3) are merely the differentials of the corresponding 
equations in (1) when the coeiHcients and unlmowns are all regarded as 
variables Note further that the matrix of the coefficients in (3) u the 
same aa that in (1) 

The right hand members of (3) ate known quantities, smee z, y, and a 
hare already been found and the magnitudes of Aa,, An,, etc , are assumed 
to be knosn Hence we may regard the nght members as constants and 
denote them by ki k, k. as udicated. Our problem now is to find upper 
limits lor the magnitodes ol the errors Ar, Ay, At 
If we solve (3) for Ax, for example, we have 


(4) 


k, a, 0 
tt b, b 
k, e, c 
4, a, e 
b, b, b 


Cl c, c, 


Let q denote the largest of the Jr's, and let us assume for the moment 
that all the k’a are equal, so that 


Then (4) becomes 


g = fe,x=k,= fe, 



1 a, 0 , 
1 b, b, 
1 Ci e, 
** *» 
bt b, b, 
Cx e, c. 


( 5 ) 
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Here it is obvious that the magnitude of Lx varies directly 'with the 
magnitude of 5, and that the upper limit of 5 ^iH give the upper limit 
of Lx. 

As the signs of the errors Lay, La-., etc. are not known, we are at liberty 
to assign to them any signs we please. We therefore assign to them such 
signs as will make all terms in the right-hand members of (3) positive. 
Let 17 be the upper limit of these errors (that is, none exceed tj in magnitude). 


Then 

LOi ^ ij, Lbi ^ 17, 

AC{gi7. 1 = 1, 2,3, 4 

and 



(G) 

(1+ kl 

f + lyl + hl)’?- 


To find the upper limits of the magnitudes of Lx, Ly, and Lz we there- 
fore replace the right-hand members of (3) by the quantity q as given 
by (6). Then the resulting system 

r ayLx -f- -fa3A2=(l-t-|a:l-}-jy]-f|2|)77 

('!') J byLx-{- biLy -}- bsLzzz: (1 -f- ] a: ] -j- 1 1 / 1 -f- ] z ])t 7 

[ CyLx -f- CjLy -j- CiLz + 

is to be solved by any method which will guarantee that the right-hand 
members of any reduced systems will be as large as possible. (Solutions 
by determinants and matrices mil not meet this requirement.) The best 
method of solution is the modified Gauss method of Art. 96. 

In eliminating the variables one at a time by that method (or any 
similar method), the left-hand members of the equations are subtracted 
ns usual ; but since the signs of errors La,, Lb,, etc. are unknown, the right- 
hand members of the equations must be added arithmelically so as to 
guarantee that those members will always be as large ns possible. We 
now illustrate the method by a simple example. 

Example. Consider the system 

rl.22i—1.32y-f 3.962= 2.12 

(6) j2.12x — 3.52^-1- 1.622 = — 1.26 

U.23x—1.21y-f 1.092= 3.22. 

wherein all numbers are rounded and correct to the number of dibits driven 
Hence v, = 0.005. ° 
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The solution of the above system i 8 z=: 0 94385,y = 1 23724,z = 06536^ 
Hence 

g = (I + 0 94385 + 1 22724 + Q 65365) X 0 005 = 0 019U37 
The system for the errors Ls, Ay, As u therefore 

22Az — 1 32Ay + 3d6As = 00l91237 

(b) -I S 12 Az — 3 52Ay + 1 62 A 2 0 0191237 

[4 23AZ-- 1 21Ay + 1 09Az = 0 0191237 

We solve (b) by the second method espUmed iQ Art 96 Tskmg the 
third of equations (b) as the pivotal equation end dividing it throughout 
by 4 23, we have 

(c) Az ^ 0 2860o2 Ay + 0 257683 Az = 0 00452097 

Now multipljing (c) throughout by 2 12 and 1 22 m succession, vie obtain 
2 12 Az 0 606430 Ay + 0 546288 As =s 0 00958445 
1 22 Ar— 0 348983 Ay + 0 3H374AS = 0 OOo51558 
Subtracting the left members of these equations from the left member^ 
of the corresponding equations to (b), but aiding the right hand members 
m each case, we obtain the reduced system 

— 2 913570 Ay + 1 073712 As = 0 0287082 
^ ^ — 0971017Ay + 3645626Ass0 0246393 

Taking the first of these two equations as pivotal equation and dividing 
throughout by —-2 913570, we have 
(e) Ay — 0 368521 As =: 0 00985326 

Now multiplying (e) throughout by — 0971017 and subtracting the 
resulting equation from the second equation of (d) (but aiding the nght 
hand members), we get 

3 287787 Az = 0 0342070, 

from which 

Az = 0 010404 

Values for Ay and Az can be found by either of two methods (1) by 
back substitution into (e) and (c), respectively, or (2) by starting with 
the given system (h) and solving for each error separately and indepen 
dently of the others^fs was done in finding Az If the method of back 
substitution IS use' * that are transposed to the right hand members 
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of (e) and (c) must be added arithmetically to the term already on that 
side. In the case of a system containing several unknowns, such continued 
adding of terms to the right members will give unnecessarily large values 
for the last errors found. In other words, the method does not give equal 
weight to all determinations. The second method is longer, but it gives 
equal weight to all determinations and is the correct method to use. 

To find Ay, for e.xampie, we write the given system (b) in the form 


3.96 A 2 + 1.22 Aj — 1.32 Ay = 0.0191237 
1.62 A 2 + 2.12 Aa:— 3.62 Ay = 0.0191237 
1.09 A 2 4- 4.23 As— 1.21 Ay = 0.0191237, 


take the first as pivotal equation, divide it throughout by 3.96, and thus 
obtain 

A 2 + 0.308081 Ax — 0.333333 Ay = 0.00482922. 


The procedure from this point onward is exactly the same as in finding Az. 
Ax is found by tlie same procedure as that just indicated for finding Ay. 

Note that in finding any particular unknown the given system of 
equations is written so that the desired unknown is in the last term in 
the left-hand members. 

The values found for Ax, Ay, and Az by separate determinations as out- 
lined above are: 


Aj = 0.0087, Ay = 0.0141, Az = 0.0104. 

In view of the fact that in finding the errors in the solutions as shown 
above, all errors were found by dividing the right-hand member of a simple 
equation of two terms by the coefficient of the error in that equation (e.y., 
3.287787 Az = 0.034207, or Az = 0.034207/3.287787), it is plain that by 
keeping the right-hand members of all equations as large as possible we, get 
the maximum values of the errors. This is the reason for adding arith- 
metically all quantities in the right-hand members. 


EXERCISES Xn 

1. Evaluate 

2 —3 1 5 
1—243 
— 1 3 2 4 

3—121 


by the pivotal method 
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2 Evaluate the above determinant bj th* triangular method. 

3 Solve for * by Cramer’s Buie 

»— ?y+2*— f = io 
3i-|.4y_ ,4. <= 4 
2t~ y + 4t—2t= 7 
5j + 2y — 3i + 2f= 9 

4 Solve the following system by the Oau<s method of Art 96 

2 38r, + 1 95 j,— 3 27x, 4* 1 58r, = 2 18 

3 21r, — 0 Bdx 4 2 42/,— 3 20r« s: 3 28 

1 Ui, 4 2 95x,— 2 14/, 4- 1 86/, = 1 42 

4 17/, 4 3 62/, — 1 68/, — 2 26/. := 5.21 

5 Evaluate the determinant of the coeUcients in the above eiercise 
Hxnt Use the product of the leading eoellicients of the pivotal equations 

6 Solve Exerci«e 3 completely bv inverting the matrix of the coefUcieBts 

7 Solve Exerci<c 4 completely by inverting the matrix of the coel^cients 

8 Solve the following aystem by the iteration process 

0 89/ 4 4 32y— 0 47/ 4 0 9SI s 3 36 

1 13/ — Q89y406U4563f = 427 
6 32/— 0 73y— 065/ 4 1 06t = 2 95 
0 74/ 4 I Oly 4 5 28/ — 0 881 =s 1 97 

9 In the lollowiag systeo) of equations the coelGaents and constant 
terms are correct to the ni mber of digits given, but no farther Solve the 
system and find the possible errors is x, y, and a 

315i— 196y 4 3 85*=: 1295 
213/4512y— 2 89* = — 8 61 
5 92/ 4 3 05y 42 15* = 8 83 

10 The solution of the aystem 

2 22/— 3 96y 4 3 11*43 86u = — 3 08 

309/ — 1 97y4623»4517u = — 1 13 
4 91/ 4 7 83y 4 9 15* 4 2 74u = 8 69 

134/— 9 86y — 2 89*— 7 23u=r 216 
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1 = 0.35949666, y = 0.44485560 

2 = 0.71214877, u = — 1.12208255. 


If the coefficients and constant terms are correct only to the number of 
digits given, find the possible errors in x, y, z, and u. 



CHAPTER XIII 


THE NUMERICAL SOLUTION OF ORDINARY 
DIFFERENTIAL EQUATIONS 

I EQaATIOKS or THE FIBST ORPEE. 

105 latrodttctioa C«rt&ui types of diSenivti&l equations m dealt vith 
m textbooks on c&lcnlus and differential equations, and methods are 
developed for eohing equations of the types treated Comparatirely f«T 
differential equations, hoverer, can be integrated in finite form Bui just 
as there are methods for finding to any dmred degree of accuracy the roots 
of any algebraic or transcendenlal eqoation baling numerical coefficients, 
so likewise there are methods for finding to any desired degree of accuracy 
the numerical solution of any ordinary differential equation haring 
numerical coefficients and gi?en initial conditions Starting with the 
initial ralues, the solutions are thence constructed by short steps ahead for 
equal intenals As = h of s, each step usually being checked by some 
method before proceeding to the next step T^e most important of the 
sereral methods for solring differential equations numerically will be 
explained in the following pages. 

106 Euler’s Method and la Modification The oldest and simplest 
method, but also the crudest, was derised by Euler A differential equation 
of the first order may be written m the symbolic form 

( 1 ) 

The integral of (1) gives y as a function of x, which may be written 
symbolically as 

(2) ^y = F(r) 

The graph of (2) is a curve m the xy plane, and since a smooth curve 
IS practically straight for a short distance from any point on it, we have 
the approximate relation (see Fig 13) 



BO that 
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Then the values of y corresponding to Xy + h), a:,(— Xz + 


are 


y* ~ 

y« ~ j/s ■{" 


By taking h small enough and proceeding in this manner, we could tabulate 
the integral of (1) as a set of corresponding values of x and y. Such was 
the method of Euler, but it is either too slow (in case h is small) or too 


Y 



inaccurate (in case h is not small) for practical use. Even if h is taken 
verj* small for all steps, it is evident from the -figure and other con- 
siderations that the computed y’s will deviate farther and farther from the 
true y’s so long as the curvature of the graph does not change. These 
considerations have led to a modification of Euler’s method, as shown below. 

Starting with the initial value y^, an approximate value for y^ is com- 
puted from the relation 

Then this approximate value of y, is substituted into the given equation 
(1) to get an approximate value of ^ at the end of the first interval, or 



310 SOLUTION OF OPDIKARY DIFFEREVTIAL EQUATIONS ICb*? XlII 

Then an improved value of Ay la found by multiplyisg h oj the aversye 
(mean) of the values of the ends of the interval z, to «„ or 


Ay: 


mA^r 


That this value of Ay ts more accurate than the value ^ ^ 
nge of y with respe 


evident 

if we think of ^ as the rate of change of y with respect to z The second 
approximation for yi is now 

s.'"-y. + - 

This improved value of yi<‘’ Ji now aabetitnted into the given equation 
(1) to get a second approximation for > or 


The third approximation for yi u then 


y,(.) 



The process is repeated until no diange js produced in the value of j/i 
to the number of digits retained. 

The computation for the next intewal z» to z,(=Xj4-h) la earned 
out m exactly the same manner, by first finding an approximate value of 
Ay and then applying the averaging process nntil no improvement is 
made in y, 

That^ihis modification of the Euler method gives a great improvement 
in accuracy over the original method can be seen by a glance at Fig 14 
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Y 
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In this figure the Ay computed by the Euler method is represented by KM. 
If PN is drawn parallel to the tangent at Q, the Ay computed by using the 
slope at Q is represented by KN. On the other hand, if we take the 
KVCT&gc of the slopes we get 

i (ir3f + KN) = + KM-\- MN) ^KM-\- ^MN, 

which is very close to its true value KQ. The attainable accuracy in any 
case is limited by the length of the step h. 

Although the modified Euler method is slow and of limited accuracy, 
its simplicity and applicability make it a method of great value; for it enables 
one to start the solution of problems where no other method will work. 

First approximations to y 2 ,y»r • • etc. could be found by means of 
the formula 



as was done above ; but as soon as two consecutive values of y are known, 
the first approximations to succeeding y’s can be found more accurately 
from the formula 
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(3) y«i=y-* + 2fcy/ 

To derive thid formula Kt the faiittioii y l>e rcprobenUd iii the neigh 
borhood of z. by Taylor’s eeriea Then 

(.) «i.+M =«».) +*f(*.) +^r(x.) 

+r,fM+T,n’-)+ 

(b) t(x.-h) =/(!•.) +!^rM-Y,rM 

Subtracting (b) from (a), we get 

w /(!.+*) -/(».-») =e‘r(«.)+yr("-.)+^r'('.) + 

In terms of y, (a) and (c) may be written 

(d) y*.t = ».+ */• + ^!("» + 

(e) y..i=y^. + 2A/. + 3-/".+ 

When A is small and only the first two terms in the right hand members 
of (d) and (e) are used, the truncation errors are and i* 
respectively, and the latter x* much smaller than the former Hence (e) 
gives a more accurate value of y..! 

The first approximations to y found from (3) are to be corrected and 
improved by the averaging proress described above 

The principal part of the error in the final value of y can be found 
as follows 

Since the increment in y for each step is obtained from the formula 



the right hand member of which has the form of the first group of terms 
in Euler’s quadrature formula, the principal part of the error in Ay is 

- ^ [r(^».)-r(^)j =-^r(£) 

by the theorem of mean value, where Za < { < z.»i 
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// As an example of the use of the modified Euler method, we compufiTa 
^ few values of y for the differential equation 


Then 


I 

with the initial conditions lo = 0, yo = 1- 
Substituting these values of x and y in the given equation, we have 

Taking A = 0.05, we then have . 

0) = y, + = 1 4- 0.05 = 1.05. ^ 

= a:, -}- yx W = 0.05 + 1.05 = 1.10. 

The second approximation to yi is therefore 

yx<") = yo + = 1 + - X 0.05 = 1.0525. 

The second approximation for is then 

^^y* = 0£^+ 1.0525 = 1.1025. . 

Then the third approximation to y, is 

yi 0) = 1 4- X 0.05 = 1.05256. - 

Continuing the approximation, we have 

f ^ = 0.05 + 1.05256= 1.10256, ^ 

y, 1 4 - - - X 0.05 = 1.05256. — 

Since this is the same as yx^’^ we can get no further change in y by con- 
tinuing the approximations. We therefore take 
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As a first approximation to jTi ve hare, hj (3), 
(w,)'**s=l + 01(11026)=:ril03 


0 1 + 11103=12103 

■+>' H V> ^ 

(y.)». =/0526 + 005(ii5ELhi™) =11104. 

(^)|"=01 + 11104 = 15101 
(y.) ■■■ = 1 0526 + ^ 1 1104, . 


Hence 

Then 

and 


which 13 the same as yi<*> We therefore take 

y,= 1 1104, = 12104 - 

Collecting our results m tabular form we have the following table 


X 

V 

du/dx 

0 00 

1 0000 

1 0000 

0 05v^ 

1 0526 

1 1026 

0 10 y 

j 1 1104 y 

I 2104 


y 


The question now arises as to the accuracy of the results found above 
Fortunately, the exact analytical solution of the given equation, with the 
stated initial conditions, is caaiJy found to be 
y = «e«— * — 1 

For z = 0, 0 05, 0 10, the correaponding values of y are 1, 1 05254, and 
1 11034 The valuea in the table above can be improved only by taking a 
emaller value for k 

107 Picard’s Method of Saccesalra Approxtnutiens. From the 


equabon 
we have 


=/(».y). 
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Art. 107j PICARD’S METHOD OF -SUCCESSIVE APPROXIM-Vnu;--; 
Integrating this between corresponding limits u,i .? anr. ; . ^ - iw. t 

- /„’*= *'*'**■= J.-’ (s) 

from which ^ 

(1) y = yo + V)ax J 

Here the integral tern in the right-hand member represents the increment 
in y produced by an increment x — a:® in x. 

Confining our attention for the,moment to the first form in (1).. :.ir.p!en‘. 

y = yc:f r 

we notice that the equation is complicitcd by the prescisie of t' unde- the 
integral sign as well as outside it. An tqiiaic-n of this ’kind !.-■ '-.rhi! -..i 
irJegral equalion and can be solved by a process of sucte^'ir. c ..pp-, -I'a:;;::- 
tions, or iteration, if the indicated integrations can .be porforined 'u The 
successive steps. 

To solve the differential equation 

by Picard’s method of successive appro,'. smations., we get a first aj'pro:iimi.- 
tion for y by putting yo for y in the inlegrand of (1). Then 


y = yo -f J f{x, yo) dx. 

The integrand is now a function of x alone and the ii'dicateu intcgnuioii 
can be performed, in theorj- at least Having now a first approjamatioh to y, 
we substitute it for y in the integraiid of (1) and integrate .'iguir:. thus 
obtaining a second approximation 

y C) =r y, -}- | -/ (t, y ) dx. 

The process is repeated in this way -as many times as mav be nc-c-c-ssarv or 
desirable, the nth appro.ximation being given. by the equation 

yWrryo-f f /(x, y <"'’>) dr. 

Wc now apply this method to the simple example 


dx 




with the initial conditions x, =. 0, — i. 
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To get a first approximation we sabstitute y = 1 m the right hand njembcr 
of the giTcn equation, thus oblainmg 

,l» = l + Jx = l + f’(i + l)dz = f + x + l 
For second and third approximations vc hare 

= i + ^*+ y+*+l + + ® + 

y'»=:l + + )ir=|^+^ + ** + t + l 

We have thus found y as a power aeriea in x For a = 0 1 we hare 
°?°°i + °^4-001 +01 + 1 = 1 1103 

Thu value of y u correct to four decimal places, as shown on page 324 
For X = 0 2 the corresponding value of y<’> is 1 2487, whereas the trui. 
value IS 1 8426 Wc could get a better value by continuing the ipproximt 
tiona to y<*>, y<", etc , but it la better to move up to the point z = 0 1 and 
start all over again 

The graphs of y<'*, y'*',y‘*', and y =s /*(*) are shewn m Fig 15 Itwfll 
be seen that the approximating curves approach the curve y = F(a} more 
closely with each successive approximation 

Now taking z s 0 1 and y = 1 1103 as initial values, we have 

y‘>' s= I 1103 + J*(x + 1 1103)iir 
= i~ + l 1103x4-0 9943 
Then for second and third approximations we get 
y”' = 1 1103 4- J]’ ^x+ ^ + 1 II03X + OD94J ^dx 
= ^ -I- 1 0552j> 4- 0 9943z 4- 1 0001 
y"> =3l 1103 4- J"* ^ff^4-^4-IO552r*4-0 9943x4-10001 '^dx 
= ^ + Qa517x*-VQ9972a?-VllRVltx-V tOQWl 

For X =: 0 2 we get y = 1 2428, which w correct to four decimal pieces 

IV e could now move up to the point z = 0 2 and start over again, but 
since this method is not much us^ in practice, we shall not continue the 
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computation by this method. 

The practical difficulties associated with the method as outlined above lie 
mostly in the difficult and sometimes impossible integrations which would 
often have to be performed many times over. For example, if we wished 
to solve the equation dy/dx— (y — ^)/{y + 2 :) with the initial conditions 
Xo = 0, yo = 1, we should have 

/.'iff 

l-f2ln (l-fi)— I, 



l-j-Sln (l-j-x) — T — T j 
1 -f 2 1n (1-f X) — x-f X 



2x 

l + 21n (1 4-x) 


) 
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and our troubles would continue to pile ap as we continued tfae approxnu 
tions The diflieulties would be far greater in other examples which might 
come up for eolatiou Foitimaielyt each dif&ealties, and indeed ill direct 
integrations, can be aroided by the methods to be explained in the next 
two articles 

108, Use cf Approxinutifig Poljaomxals. We aroid the diScuItiei put 
tnenlioned by replacing ^ ^ polynomial and then integrating this 

polynomial over any desired interval The appropriate polynomial for 
this purpose is that given by Newton's formula (II), because in the 
numerical integration of differential equationi we alwayi start with gireo 
values (imtul conditiooa) and conatruct the solution from that pact 
onward Hence the values of the function immediately behind ns are 
always known, hut the values ahead are unknown ‘Hie problem is always 
to find the next value ahead 

Writing / in place of ^ tad replacing y by / m formula (II), p M, 
we have 

(,) ^ 4 - + ■!(“+ 

. i.(i.-nx«+a)(« + »i . ■ 

= ,'. + 4y.«+ ^ (•• + «> + ^(«- + 5i.*+M) 

+ ^ («' -(-W + «.• + 6.), 

where 

tt =s — j — or » = X* + Au 

Since the change in jr for any interval u given by the formula 

we can find by means of (1) the change in y over any interval where 
dy/di IS continuous We therefore have for any interval Xk,i — Xu 

Ay = ^S'. + A,y',ii + (tt* + «) 

+ ^ («’ + 3tt* + 2tt) («* + 6u* + lltt* + 6tt)] dx 
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Ay 


or 
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Since x=:Xn + hu, we have dx = Mu. Substituting this value for dx 
above and changing limits, we get 

= h J "" [ y'„ + A.y'„u + ^ («- + «) + ^1^ (u^ + + 2u) 

+ ^4^ («' + -r + 6u^ du, 

(2) Ay = h [y'nu + A.y'n y + + y) + ^(t + “* + 

Let us now compute the value of Ay for the intervals x,.^i — x„, x„ — 
iCn-i — in-si etc. by substituting in (2) the proper limits for u. For the 
interval z„,i — 1 „ the limits for u are 

Xn) /h — /l/A — 1, Uk — ^Xji Xn)//l — 0. 

On substituting these in (2) and simplifying, we get 

= -f il** = ^ l^y'" + ^ ^ly'n + ^sy'n + g Aay'n + A«y'„ J . 
For the interval Xn — Xn-i the limits for u are 


Xn 

Uk.i = — r = 0, ttjt 


" — Xn •"*' h ^ 

- «■ 


and therefore 

— ^‘[^y" 12 M " — vio J ■ 

Proceeding in the same way for the other intervals, we get formulas 
for the changes in y in those intervals. The results for the several 
intervals are; 

(108. 1) ;;•■ = j [/. + 1 A,/. +±.,y. + 1 _ 

(los. 2) /:., = * [y. oy. _i A,/. _ A A.J., __ ^ _ 

(108. S) ^ [/.-I A,„-, + A A.,/. + A A.,-. + A^ A.,-.] , 

(108.4) [/.-I Ay. +|| a.,-.-| A.,-._^A,y,] . 

(108.8) =A Ay. +|Ay.-|| Ay. + ||i Ay.] . 
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In the application of fomulas (108 1) and (108 2) the coefficients^ 

19 11 

and 1^ may be rcplacod bj - and — . respectively 

Dy adding (108 1) and (108 2) and then (108 2) and (1083), ve get 
the following additional formulas. 

(108 6) / [ 2,-. + j iy. + 1 4.,-. + III jy.] 

= 2 A [s'. +|(4y. + oy. + oy.) - i ^y.] 

(108 7 ) / ; . = 21 [ - 4 y. + 1 iy. - i 4.,'. ] 

Ileplacing the first and second difference in (108 7) by their values in 
terms of the y'’a, namely 

s= Jf*. — , A,/, = /. — 2/. , + , 


and simplifying, wc may write (108 7) la the equivaleat form 
(108.8) =|(/. + 4,-.,+,'..)-^4y., 

ninth at lecogni/t at ontt as Simpson’s Rule with its remainder term 
Instead ol using (108 1) for ootnputiog the first approximation to Ay 
in the next step ahead and checking it by (108 2), we may use explicit 
formulas for the approximate and torrected values of the next y ahead 
Since 

= y.. 

we may replace /•*” by this value in (106 1) and obtain the formula 

(108. B) y.,1 = y, + -j. 1 a,,/. + A a,/. + | a,/. + ^ A,/ .1, 

a bar being placed over y,,i to indicate that it is a first approximstion 
obtained by extrapolation Then when (108 8) is applied to the new 
interval, the n and n — 1 in that formula become n + f "» respectively 
Hence the corrected y at the forward end of the new interval is given by 
the formula 


(108. 10) y... 

= y. + A I y'-.i — i A.y',., - 
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where is the value of y' obtained from the given equation when the y 
therein is replaced by the i/n*i found from (108.9). 

In like manner, when (108.6) and (108.8) are replaced by explicit 

formulas for y, we get 

(108. 11) y,ul = Vn-i + 2^ [/« + I (A.y' n + ^ 3 / " + ^♦y'n) ~ 

(108. 155) yn.i = yn -1 + + 4y'„ -f y'«-i) — ^ 

respectively, the ^ n*i being found from the given equation as above. 

Now a word as to the use of the foregong formulas. Formulas (108. 1), 
(108.6), (108.9), and (108.11) are formulas for integrating ahead by 
extrapolation. They are used to start a new line in the computation and 
are used only once in each step-interval. 

Formulas (108.2), (108.7), (108.8), (108.10), and (108.12) are used 
for checking and correcting the extrapolated values found by the formulas 
for integrating ahead. They may be used more than once in any step- 
inten’al. 

The intervals covered by these formulas are shown graphically in Figure 
16. 

! — j 1 — 1 » 

n-4 n-3 n-2 n-1 n Ji+I 

Fig. 1C 

Formulas (108. 1) and (108.2) are the main tools which we shall use in 
the numerical integration of ordinary differential equations. It is needless 
to say that all the foregoing formulas apply equally well when the variables 
are any quantities whatever — time and acceleration, time and velocity, etc. 
Their use will be illustrated by several examples in the pages ahead. 

Historical Note. The method of replacing the derivative of a function 
by a polynomial and integrating that polynomial over an interval was used 
by J. C. Adams as early as 1855.* Adams derived formulas (108.1) and 
(108.2), but he did not use (108.1). He used (108.2) in the manner 
indicated on page 3‘2o and then applied a correction formula. 


* An Alterr.pl to Test the Theories of Cepittary Attraction, by F. Bashforth and 
J. C. Adam», Cambridge University Press, 1083. .‘?ee the Introduction and Chapter 
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EtampU We return once more to the differential equation 



In Art 106 we computed the entnea ja the following table, except that 
now we have added on the columns of differences 



V 1 

V' 

A in' 


0 00 

1 OGOO 1 

1 0000 



0 05 

1 0525 1 

1 1026 

+0 1026 


0 10 1 

1 not j 

1 2I(H 

•fO 1078 

+52 


Before proceeding further with the computation we had better check 
the values already found If x. denotes the third value of z in the table, 
then the second and first values will be i. i and *, „ respectively (See 
Fig J6 ) To compute the increment in y for the first interval and thereby 
find y, we apply formula (108 3), since it covers the interval aw-i— 

We therefore have 

AJ - 0 05 2104 — I (0 1078) + ^ (0 0052)] - 0 05254 

yi — y« + Ay — 1 0525 

For the second interval we spply (108 2) Then 

Ay — 005 [i 2104 — 1(01078) — i (0 0052)] -005780 
The corrected values of y are therefore y, 1 0525, 
y, — 1 0525 + 0 0578 — 1 1103 

We now make a new table containing the corrected values for y, y^, end 
the first and second differences of y' We also insert in this table a column 
for Ay as a matter of convenience 


* 1 

y 

Ay 

V’ 

Ai/ 

A.v' 

Ai/ 

0 00 1 
0 05 

0 10 

0 15 

0 20 j 

: ooo 1 

I 0525 

1 1103 

1 1736 j 
1 2427 

+0 0525 
+0 0578 1 
+0 0633 1 
1 +0 0691 

1 000 i 
1 1025 

1 2103 { 
1 3236 j 
1 4427 

+0 1025 
+0 J078 
+0 1133 j 
1 +0 1191 

+63 1 
1 +55 

1 +W 1 

+2 

+1 


The computation i9 continued by adding 


line to the above table. 
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the line for a; = 0.15. The first step is to compute a new Ay by means of 
formula (108.1), using the data of the third line; 

Ay 0.05 [^1.2103 + 1 (0.1078) (0.0053) J =0.0633. 

y,a) ,= 1.1103 4- 0.0633 = 1.1736. 

Then 

(t,')3<0 = 0.15 4- 1.1736 = 1.3236. 

The next step is to enter these values of y and y^ in the fourth line of the 
table and then compute the differences of y', as shown in the table. The 
entries in this line must now be checked and improved upon if possible 
by means of formula (108.2). Thus, 

Ay = 0.05 [l.3236 — | (0.1133) — — (0.0055)^ = 0.0633. 

Since this is the same value for y as previously found, there is no possibility 
cf improving upon the results in the fourth line and we therefore take them 
to be correct to four decimal places. 

The fifth line in the table is computed in exactly the same way and is 
found to be correct at the first trial. 

The fact that the correct values of y were found at the first trial in 
lines four and five suggests that it may be expedient to double the interval 
of integration, in order to progress more rapidly. We therefore take 
h = 0.10 and make a new table with differences to correspond to the longer 
interval. 


X 


Ay 

y" 

0.0 

1.0000 


1.0000 

O.I 

1.1103 

+0.1103 

I. 2103 

0.2 

1.2427 

0.1324 

1.4427 

0.3 

1.3905 

0.156S 

1.6995 

0.3 

1.3996 

0.1569 

1.6996 

0.4 

1.5S35 

0.1839 

1.9S35 

0.5 

1.7973 

0.2138 

2.2973 

0.6 

2.0441 

0.2468 

2.6441 

0.7 

2.3274 

0.2S33 

3.0274 

O.S 

2.6510 

0.3236 

3.4510 

o.g 

3.0191 

0.36S1 

3.9191 

1.0 

5.4364 

0.4173 

4.4364 

1.0 

3.4365 

0.4174 

4.4365 


A,y' 

A.y' 

Ajj/' 

Ajj/ 

+0.2103 

+0.2324 

+0.2568 

1 

+221 

+244 

+23 


+0.2559 

+245 

+24 


+0.2839 

+270 

+25 

1 

+0.3138 

299 

+29 

4 

+0.3468 

330 

+31 

2 

+0.3833 

365 

+35 

4 

0.4236 

403 

38 

3 

0.4681 

445 

42 

4 

0.5173 

492 

47 

5 

0.5174 

493 

48 

6 


To start the line for x = 0.3, we first compute Ay by means of (108. 1), 
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using the data in t))C line lor OS ^\e have 

Ay — 0 1 [1 4427 + 0 1402 + 0 00D2] — 0 1568 

Hence g ‘‘i — 1 2427 + 0 4^68— 1 3305, and (g')'V = 16995 W«mi 
enter these values in the table and compute the differences far that hna 
Checking these values by meani of (103 2), we get 

Ay — 0 1(1 6995 —0 1284 —0 0020 — 0 0001) — 0 1569 

Siace this value of Ay la different from that previously found, we repat 
the line for z » 0 3 and write this value of Ay in the new Ime The second 
approiimationa for y»i and {^)t$ are then 

yo‘V— 1 2427 + 0 1569 — 1 3995, 

(1^)0**.’— 1 6996 

Entering these values in (he new line, computing the corresponding dif 
ferences, and then applying formula (108 2) to the data of thu line, ve 
hare 

Ay — 0 1(1 6996 — 0 1284 — 0 0020 — 0 0002) — 0 1569 

Since this is the same value for Ay as previously found, we consider the 
resnlts in this second line for « ^0 3 to he correct. 

The computations are continued tip to z «« 1, os shown in the table 
It so happens that formula (108 1) gives the comet result for every Iwe 
except the last Fourth differences were used is formula (108 1), but 
not in (108 2) 

Since the exact solutim of the diflereutisl equation iy/ix — z + y» 
the initial conditions z« — 0, y, . 1, 1$ 


y 


-.2e' — z — 1, 


we can compete the exact value ol y cotiespondiTig to any value of i The 
following table gives the correct values of y for values of t differing by 
one tenth 
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It will be noticed that the values found by numerical integration are 
in error by one unit in the last decimal place, beginning with the value for 
X •=» 0.2. The truth is that the source of these errors is in the value 1.2427, 
which is in error by one unit in the last figure. This error was simply 
carried on bj* addition throughout the table. To avoid such errors it is 
necessary to have the first two or three lines in the table correct. 

Note. There is another method for starting a new line in the table 
without the use of formula (108. 1). It consists in assuming that the highest 
difiercnce in the next line will ha the same as in the line just finished, and 
then working backwards by adding the new differences to the values in 
the previous line. For example, suppose we take the line for x — 0.8 and 
try to find the next line. We have 


X 

y 

Ay 

y' 

Aiy' 

Aiy' 

Asy' 

0.8 

i 9 

0.3236 

3.4510 

0.4236 

403 

38 

0.9 

\ B 

0.36S1 

(3.9187) 

(0.4677) 

(441) 

(38) 

0.9 

! B 

0.36S1 

3.9191 

0.4681 

445 

42 


The first step in this procedure was to assume that the third difference 
in the line for x = 0.9 was 0.0038, the same value as given in the line above. 
Then we added this 0.0038 to the second difference 0.0403 in the line above. 
This gave us a second difference for the new line. We added this 0.0441 
to the first difference in the line above and obtained a new first difference 

O. 4677. This was then added to the previous y' to get the value 3.9187 for 
y' in the new line. 

The next step is to apply formula (108.2) to this new line, using the 
quantities enclosed in parentheses (these quantities are enclosed in paren- 
theses to indicate that they are trial or assumed values). We thus get 

Ay « 0.1 (3.9187 — 0.2338 — 0.0037 — 0.0002) = 0.3681. 

This value of Ay happens to be correct. We now add this to the previous 
y to get the new value of y and thus complete the line. But now thfe new 
y' must be computed by adding the value of x to this new y. We therefore 
repeat the line for x = 0.9 and insert the correct values of all the quantities. 
In some instances it would be necessary to correct this second line. 

The method just outlined in this note is the one used by J. C. Adams and 

P. B, Moulton. It is not as much trouble to apply as it may seem from the 
description above, but nevertheless it requires more labor than the method 
of integrating ahead by (108. 1) and will therefore not be used in this book. 


109 . Methods of Starting the Solution. The determination of the first 
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few valaes of the functioa is the most important and usnallj the most 
laborious part in the numerical solotion of a differential equation. It u 
the most important part because the first few values must be aceuratt U 
the number of significant figures desired in the solution, and it is the most 
laborious because the first few values are sometimes not easilj found to 
the desired accuracy 

Formulas (lOS 1) and (108 2) involve the first four differences of the 
function ifi These differences can be constructed only when five consecu 
tive values of y' are known The first value of y' can be found from the 
given equation and the initial values of x and y, the remaining four can 
be found by one or more of several methods, the most important of which 
are the following 

I By Taylor's Senes If y = f(x), the familiar Taylor formula 


(1) ft») =/(l.) +f(T.)(,-T,) 


may be written in the less familiar form 

(s) s = j. + y”. (* — I.) + (» — I.)' + ^ (* — »•)■ 

where Xt and yt denote the initial values of x and y In finding jfis by 
formula (2) it is desirable to keep \x — x, \ npmencally small in order 
to have rapid convergence of the senes and therefore high accuracy in 
the y’s Bence in general we should work on both sides of the point x», 
that IS, we «hould compute y’s both to the right and to the left of the 
point xzxxt Using the notation yi = f(*e + ^). yi^/C^o + ^h)* 
y , — /(x* — A), y I =/(r* — 2A), etc, we have from (2) 



(3) y,=y, + y'.A + 

(4) y. = y. + y',(2A) + 

TO y. = y.-y-.w + 

where h denotes the interval between the equidistant values of x 
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If the successive derivatives of the given differential equation y' — f{x, y) 
are easily found, the five needed consecutive values of y' can be found from 
the initial conditions, the given equation, and the formulas (3)-(6) above. 

Example 1. Let the given differential equation be 

^=:y' = ®-fy, with io = 0, yo = l. 
ax 

Here 

y' = x + y, y" = l + i/, _y'" = y", y^ = y"', y- = r 
Hence . ' " 

y'e rrio -f- I/o — Ij y^o = l + yo = 2, y" = y'' = 2, y''=y =2, y'^ = 2. 

f 

Now taking h = 0.1 end substituting in (3), (4), (5), (6), we get 

yi = 1.1103, y, = 1.2428, y.i = 0.9097, y.i = 0.8375. 

These values are ell correct to four decimal places. The five desired con- 
secutive values of t/ are now found from the given equation to be : 

/-s = X., -f y., = _ 0.2 -f 0.8375 = 0.6375 
/.i = x.j -f y.i = _ 0.1 -f 0.9097 = 0.8097 
/« = xo 4- yo = 1 

y'l = X, -f yi = 0.1 -f 1.1103 = 1.2103 
Jr's = X- 4- yj = 0.2 4- 1.2428 = 1.4^8. 

If the function y should be non-existent for values of x less than Xo, * 
then we compute y^s only to the right of Xo by substituting in (2) the 
proper values of h. 


2. By ^tine's Formulas. It frequently happens that the higher deriva- 
tives of y' = f (x, y) cannot be found without excessive labor, or hardly 
at all. In such cases the above method cannot be used for starting the 
computation. If, however, the first derivative of j/' = /(x,y), or y", can 
be found without difficulty, the five starting values of y' can be found by 
certain formulas first used by W. E. Milne.* To derive these formulas 
we need two additional Taylor series similar to (3) and (5). 

Representing the function y', or in the neighborhood of x = Xo by 
Taylor’s series, we have 


Yo4-y"eA4-'^' 


• O I * * • 


( 7 ) iTr- 

2 * 3 ! ' 4 ! 

•Xnfrican 1! at%tmatical ifonthJi/, Vol. 48 (1941), p. 52. 


4 - 
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/, = /, — y",4-f 




vVi* 

4' 


Adding (7) and (8) and then sobtnctiDg (8) from (7), we get 


(3) s-. + y’.=2j'. + sr^>+^ + 

( 10 ) = + 

Now solre (9) for y"\, (10) for and then aubatitute these Tiluesin 
(8) and (5) The lesulla ate 

(A) y»=y«+^(y'. + J6/. + 7/,) 

(B) J. = y.— ^(V. + '6!i'. + y'0 + ^^ + ^ 

These formulas gire yi and y t as aooc as y' i and y'l are known 

To find formulas giving y, and y t substitute in (4) and (6) the vaJnes 
of and y”, found from (9) and (10) The results arc 

<C) y. = y. + f ( V. - - sr" I ) - s y'-‘‘- 

(B) y, = y.-^ (s/,_/._y'.)-2y"^'-iy.»‘ 

These formulas wiU give y, and y > as soon as / ■ and / 1 are known 
An additional formula is desirable for checking y and y i when found 
from (C) and (D) Subtracting (B) from (A), we get 

y.-y.=5(y'. + iy'. + y'.)-*^. 

Since this formula holds for any interral of width 2Ji, we may write it as 
a general formula 

(E) y.., = y^. + |(y'^. + 4y'. + y'..,)-^ 

The quantity^ (y', , + 4/, + y*, ,) is eridontly Simpson’s Ilule and ii 
an approximation to the definite integral JJy'if^y which represents the 
increment in y for the two intervals from x, — h to z, + ^ 

In the application of fomiulas (A) (E) the terms la y*» are omitted. 
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The formulas as used are thus accurate np to and including fourth 
differences. 

It is to be noted that the second derivative y" is to be evaluated only 
at the one point (xo, t/o) • 

Concerning the use of the foregoing formulas, the first step is to 
compute trial values of y'l and y'.x from the relations 

(F) y'i=y'o + W'ti /-i =y'o — (Euler method) . 

Then subsHtutc these in (A) and (B) to get first approximations to 
and y.i. These approximate values of yi and y_i, with the corresponding 
Xi and i-i, are then substituted into the given differential equation 
y'‘^f{x,y) to get improved values for y'^ and y'.i, which in turn are 
substituted back into (A) and (B) to get better values for y^ and y.i. 
This iteration process is continued until no change is produced in y'l 
and y'-i. To obtain high accuracy in y'., and y'l the value of h must 
be small. 

Now having the three consecutive values y'-i, y'o, y'l to the desired 
degree of accuracy, we substitute them in (C) and (D) to get approximate 
values of y- and j/.. by extrapolation. Then these, together with Sj and s.j, 
arc substituted into the given equation to get approximate values of y's 
and y'.t. These latter are then substituted into formula (E) to get 
improved values of yj and y... If these agree with the previous values 
found by extrapolation, we take them as correct. Then these values when 
substituted into the given equation will give correct values for y '2 and y'.,. 
We thus obtain the five needed consecutive values of y' to give us the 
various orders of differences to use in (108.1). 


Note. After having found y'o, and y'l to the desired degree of 
accuracy, we could form first and second differences from these and then 
proceed witli formulas (108.1) and (108.2). 


Excmple £. To find five consecutive values of y' for starting the solu- 
tion of the equation 


y' = withyo = l, So = 0, 

wo have 


Hence 
Taking h 


,/r — (^ + y') -f y) —xy(Zx -f 2yy') 
{x-^+y'-y 

^, = 0, y"o=l. 

— 0-l» have from formulas (F) 

0.1(1) =0.1, y'-, =0 — 0.1= — 0.1. 
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Then by (A) and (B), 

yi“' = 1 + II (— 0 1 + 0 7) + = 1 0050, 

y lOl = I — 11 (— 0y + 01)=l 0050 

Nov substituting these y*s and the corresponding Sr’s uto the giren 
equation, ve bare 

^- _( 01 ) 0005 ) 01005 _ _oo3», 

(01)»+(1005)*“0 01 + 10100M” ' 

009S5S 

On subetituting these into (A) and (B), ve get 

y,(«) r= 1 + |i (— 0 0985S + 0 68971 > + 0 0025 s= 1 0O««, 
y =: 1 00496 

Nov lubstituiing these into the given equation, ve have 


jr'.= 


(OlMlOOiSO) _ 0100496 , 
(0X)» +(1 00496)*'” 101994 “ 
0 09859 


As these are the same Tslues as prertously found for y*} and y'.u ve tihs 
them to be eoneet « 

Saring "dug in," as >t were, about the point (s«,y*) uid found three 
consecutive values of y' to the desired degree of accuracy, ve next find 
y 1 and yt by extrapolating backward and forward by means of formulas 
(C) and (D) From (C) and (D) we have 


y, — 1 + H (0 59118) — 0 02 = 1 0194, 

y , = 1 — ^ (—0 59118) — 0 02 — 1 0194 

These values must now be chedied by formula (E) after first fining 
and y ' t from the giving equation Substituting in the given equation 
the value of *i(— 2A — 02) and the value of y» found above, we have ' 


. _ 0 2(10194) _ 0 20388 _ 

(0 2)*+ (10194)* 107918 

Likewise, for i»(— — 2A — — 02) and the value of y » found above, 
we get 

-0 2(1 om> 


y',= 


(—0 2)*+ (1 0194) 


s= — 018892 
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Then from formula (E), 

Jf2 =.yo + g (y'o + 'iy'i-i-jls) 

_14.M(o + 4X 0.09853 + 0.18892) = 1.0194. 
o 

For checking the backward value y.^ we write formula (E) in the trans- 
posed form 

Jln-i “ Vm — ^ (y' «-l + 4y'n “I- y'nn) . 

Hence we have 

y-2 •=yo — ^ (y ' -s + + y o) 

= 1 _ — 0.18892 — 4 X 0.09853) =: 1.0194. 

3 

Since these values arc the same as those found by extrapolation, we con- 
sider them to he correct. 

Now having five correct consecutive values for y and y', we can form 
differences up to and including the fourth for these quantities and proceed 
with the numerical solution by means of formulas (108.1) and (108.2). 
At this point it is instructive to compare these computed values of y and 

if with their exact values. The homogeneous equation y — cfin 

readily be solved by the usual artifice of putting y = vx. The solution, 
with the given initial conditions, is found to be 


I* =z y* In y*. 

The Newton-Raphson method, when applied to this equation, shows that 
y, should be corrected by the amount 0.000003 and y^ by the amount 
0.00003. The values previously found are thus true to the number of 
significant figures retained in the computation. 

3. By the Rungc-Kulta Method. The use of this method will be ex- 
plained in a subsequent article. 

4. By the Modified Euler Method. This method has been explained in 
Article 106. It can be used for starting the numerical solution of any 
ordinary differential equation and is used when the previously-explained 
methods cannot be used to advantage. 

After the five consecutive starting values have been found, the numerical 
solution of a differential equation is continued as far as desired by means of 
formulas (108. 1) and (108. 2). This part of the solution is mostly smooth 
sailing. If the differences higher than the second become negligible, it will 
be well to double the interval h. When this is done, a new table of differences 



•?).* MHUTION or ORDIN\R> DWfCIUNTUI LQIATIOXS [Chap Xm 


must be constructed for the wider iiiiervft), using tlie previous!) computed 
values of y’ for tins purfiose 

If, on the other hand, tlie fouKii dilTcrences should become large, or if 
several trial computntions should be ri>qiiirc«l to obtain the correct result, 



place (or in the last signilicoiit figure retained in the computation), then 
the intcnal h should he reduced h) Vulf and the computation continued 
with the shorter interval as far as majr seem necessary Ihe best way of 
reducing the interval is explained below 


110. Halnag the iDterral for h. Since the process of reducing the 
interval is the same as beginning a new solution of the given equation, it is 
absolutely necessary that five i-onseculirc values of / be known accurately 
in the region where the new computation is to begin The best uoy to find 
accurate values at the midpoints of old intervals is to use Dcssel’s formula 
for interpolating to halves, namely 

where y'^l8 the value of y’ halfway between tj\ and /i Note that the 
differences used in thi'> formula arc ordinary Jiayottal diffirtnecs It will 
be necessary to find th« value of / at two midintervals in order to have five 
consecutive values for starting the computstion with halved intervals 
Eramplc The numerical solution of the equation / = x + y is tabu- 
lated on jiagi 143 (tom 1 = 0 to r = I Swjqvo^ it were desired to reduce 
the interval by half from the point x = 0 6 onward 


Selufion We take x = 0 6 as the aero point and then rewrite the dif 
fercnces of the /N in diagonal difference form, as shown below 
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Then for x = 0.65, we have 

2.6441 -f 3.0274 1 0.0365 -f 0.0403 

yoej— 2 8 2 


3 0^0003_-f0;0^_2_g3.g_QQQ^g_ 28310 , 

• too 9 


128 


and 


, 3.0274 + 3.4510 1 0.0403 + 0.0445 _ , 

yo.75— 2 8 2 ‘ ■ 

The five starting values for the new table, considering only y , would be 
as shown below; 


X 

y' 

A,v' 

Ajt/' 

Aiy' 

Aiy' 

0 60 

2.64-11 





0-65 1 

2 8310 

+0.1 S69 




0.70 

3 0274 

0.1964 

95 



0.75 

3 2339 

0.2065 

101 

6 


0 SO 

3 4510 

0.2171 

106 

5 

-1 

0 S5 

3 6792 

0.22S2 

111 

5 

0 

0 90 

3 9191 

0.2399 

117 

1 

6 

1 


Continuing the computations, we apply (108. 1) to the line for a; = 0.80 
and get 


Then 

Hence 


^y = 0.05 [3.4510 + 0.1086 + 0.0044 + 0.0002] = 0.1782. 


t/o.„ = 2.6510 + 0.1782 = 2.8292. 


yVss = 0.85 + 2.8292 = 3.6792. 


We ne.vt fill in the line for x=0.85 and apply (108. 2) to this line as a 
check. We have 


Ay = 0.05[3.G792 — 0.1141 — 0.0009] = 0.1782, 
which is the same as before. 

We continue the t.able through the line x — 0.90 to see if the new schedule 
with halved intervals gives the values previously found. Applying (108. 1) 
to the line for x = 0.85, we have 

Ay = 0.05[3.G792 + 0.1141 + 0.004G + 0.0002] = 0.1899. 

Hence 

i/o »» = 2.8292 + 0.1899 = 3.0191. 
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m 


Then 


Jr's „ = 0 90 + 3 0191 = 3 9191 

These are the same values as prerionsly found before the interval was halved, 
and they indicate that no error was introduced in changing to the ihorter 
interval It is to be noted that the shorter interval reduces the fourth 
differences to insignificance 


zuscisss zni 


1 Obtain b} the modified Eoler metliod five consecutive starting values 
for the numerical solution of 


is. 

di 


= log.. 


with x«s20, y«sS Check the starting values by formulas (108 S)to 
(108 5) and then add two more lines to your table 
2 Obtain by Taylor’s series five consecutive starting values for the 
numerical solution of 


with = 1, y. a: 3 Check the values and then ftdd three more buM to 
the table 

Compare your results with those obUiced from the exact analytical solu- 
tion y = 2r + 3e‘ • 2 

3 Tabulate the numerical solution of 


= sm z -f- cos y 

from x» = 30*, y»=:45® to z = 60* 

4 . Use the Taylor series method to start the numerical solution of 


with X. = 1, y. = 0 


ii 

dx 


=**+y*. 


5 Given the equation 

«^y_ *,J7rv 
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with a;o = l, yo = l/4; find {d-y/dx-)a and then find five consecutive 
starting values hy means of the Euler method and the Milne formulas. 
Note that a solution exists only in the regions where | x/2y | > 1. 

6. Integrate the equation of Ex. 2 by Picard’s method of successive 
approximations. ^ 

11. EQUATIONS OF THE SECOND ORDER AND SYSTEMS OF 
SIMULTANEOUS EQUATIONS. 

111. Equations of the Second Order. Any differential equation of the 
second or higher order can be reduced to a system of first-order equations 
by the introduction of auxiliary variables. Thus, the second-order equation 

can be reduced to two first-order equations by putting y’ = dy/dx. The 
resulting equations are 

dy dt/ „ 

■£=y^ =fM-Ps’~Qy. 

In like manner, any equation higher than the second order or any system 
of equations of the second or higher order can be reduced to a system of 
equations of the first order. These first-order equations can then be solved 
by the methods already given, or soon to be given. 

Second-order differential equations can also be integrated numerically 
by the following formulas, adapted from (108.9) and (108.10) : 


(1) _ y\ -f h{y"„ -f i A,y", + A A.y"„ -f | + i A,y"„), 

for getting the trial value of 


(2) — yn + A(p'„„— I — ^ — ^ 

for getting a first approximation to the new y„,i. 

(3) rn.x = /(T,.0-Fu'„.x— 

the given equation, for getting the first approximation of 
y" at aw,,. 
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(4) + 

-iA./-..,). 

for ch<*ctiijp and cormtin^ the trial found from (1) 


Similar integratioa fonaulaa can be obtained from (108 U) and (108 U) 
The cpverlincd quantities S,.,» y"«.i »re ao marked to indicate that 

they are the first ei>proaimat(ons to y, y', and at the point x=:z^i 


Example IVhcn a pendulum snings in a rcsisitng medium, its equation 
of motion IS o! the form 


uliere a and 6 are constants Assuming a =: 0 2, fi =: 10, start the solution 
o! the above equalion, taking as initial eonditions 9 s: 03 radian and 
d6/dt s= 0 wlien i « 0 


iSofution Tlic substitutions d0/dt = 9, d'6/dl* = d9/dt st 9 reduce the 
given equation to the two first>or«lcr equations 



di 

dt 




— 029 -10 sin 9 


Since the second equation iniohcs 9 dircctl), jl la necessary to compute 
this angle at every step throughout the computation Al'O, since 9 m this 
problem is always expressed in radians, it is praitioally neccBsary to uses 
table of sines m which the argument is given direcil} in radians * 

After the starting values have betii found, the solutiou of this exsmple 
will be continued by means of the following formulas. Used m the order 
written 


(1) Afl = J* 9 dt = Af (tf, + i A, 9. + ~ A,9« + ^ A, 9, + ^ *,9,), 
for starting a new line 


(2) a9 


~ ^ ' 9rft = A 




* Th« best table o( tliia kind is of Cxrcvlar and Hypetholte S\ne* a* 

/or Rodiff I Argumtnlt TorV 1939 


id Coti’Ui 
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for finding the first approximation to 6 at time 


3;i7 


(3) — — 0.2 — 10 sin 

for finding the first approximation to 6 at time 

(4) A0— I § dt — ^2^n+i 

1 2 . 

38 

for checking and correcting the value of Afl foimd by (1). 

The 6, 6, and •6 for the instant are underlined to indicate that 
they are the first approximations. 

If the first cycle of calculations for a step interval does not give results 
of the required accuracy, a new computation is made by applying (2), 
(3), and (4) in the order here given. 


The starting values for this problem can be found by any of the methods 
mentioned in Art. 109. We shall find them by the Taylor-series method. 
The Taylor series for 6 is 


(5) e = + 




4! 


5! 


6 ! 


+ • 


From the given equation 6 = — 0.2^ — 10 sin B we get 
e = — 0.20 — 100 cos 0 


0’'’ = — 0.20 + 10(0*= sin 0 — 0 cos 0) 

0'^ == — 0.20"- + 10 [ (0= — 0) cos 0 + 300 sin 0] 

0''‘ = — 0.20'’ + 10 [(3^0 — 0''’) cos 0— (0* — 0 0) sin0 
+ 3 (0=0 cos 0 + *0= sin 0 + 0 0 sin 0) ]. 


For 0 = 0.3 radian, 0 = 0 when t = 0, the above equations give 

00 = — 10 sin 0.3 = — 2.9552, 

00 = — O.20O = 0.2 X 2.9552 = 0.59104, 

= — O.20O — 1000 cos 0.3 = — 0.1182 + 28.2321 = 28.1139, 

^0 — O.20‘'o — 1000 cos 0.3 = — 5.6228 — 5.6464 = 11 2692 

0''o = 0.20^0 lO0''o cos 0.3 + 300= sin 0.3 = 2.254 — 268.582 + 77 425 

= — 188.903. 
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Subatitating in (5) these vslnee snd the initial conditions, ve get 


( 6 ) 


2 ^6 ^24 120 

188 90 .. 

720 


DiffeTentisling (S) -with rnpect to t, we haTe 

We are now ready to find starting values of 6, 6, and S for values of I 


near aero and at steps of ^sec Putting ( 0. (®) 

and (7) and then computing the corresponding valnee of S from (l),vc 
get the first five values of these quantities as given in the table on the 
following page 

After forming the various orders of differences for these quantities, 
we are ready to extend the table by applying formulas (1), (2), (3), 
(4), etc Two additional lines computed m this manner are given in the 
table The actual computation of the line for t ss 0 15 was as foUoirs 
^ppUing formula (11 to the acceleration quantities in the line for 
t ss 0 10, wc have 


ss ^ 2 758 + 0 066 + 0 029^ ss — 0 1332 

This IS the first entry m the new line for f -• 0 15 Adding this AS to 
the previous value of 6, we gel —04211 for the new 0 Now compute 


the various orders of differences for the new $ 


Me ne\t compute A9 for this line by applying (2) to the 6 quantities 
We thus have 

4^ — .i [_ 0 4211 4- 0 0666 — 0 0007 — 0 0001] = — 0 0178 
Adding this to the previous value of 0, we hare 

„ = 0 2854 — 0 0178 — 0 2676 

Me nert substitute in the given equation (3) the value* of $ and 6 for 
the new line, in order to get the acceleration when f = 015 We thus 
'inm: 

6 = — 0 2(— 0 4211) — 10 Bin 0 2676 = —2 560 
Then we compute the several ordera of differences for this acceleration 
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The line for i = 0 15 is now completely filled, but it must be checkei 
Hence we apply formula to the areeleration data last fiUexl in andbiif 

± r_ 2 560 — 0 099 — 0 005 1 = — 0 1 '\32 

Since this is the same value of AO as previously found, there is no possi 
bility of improving any of the entries m the line for t = 015 and ae 
therefore regard them as correct 

Succeeding lines arc added to the (able in exactly the same manner as 
above described 

In this example the time interval At must be taken short, because S,$, 
and 6 are all changing rapidly To obtain fesjlU accurate to fonr 

significant figures At should he kept at ^ second 

Space does not permit the higher differences of 6 to be shown in the 
table, but these differences should always be computed as a check on the 
accuracy of the computed values of 6 
Another check formula for second-order differentisl equations u {112 2) 
of the next article 

Let us rheck the value of 0» , in the above table by formula (112 2) We 
have 

^» « = 2 (0 2C76) — 0 2854 + 2 SCO + -f; (0 061) ] = 0 2431, 

which is the \alue already found and iliecked by (O 

112 Second Order Equations with First Denvative Absent. When 
second-order dilferenlial equations do not conta n hrst derivatives, their 
numerical solutions can W found by a shorter method than that employed 
m the preceding article In this case wc nplacc the xeeonil Jencafipe by 
a polynomial and integrate twice to find the desired formulas for numerical 
integration 

We consider first the single equation 

(■) g=/(^.»). 

which we write m the form 

m y" = /(.:.») 

To find a formula (or integrating ahead by extrapolation wc start with 
Newton’s formula II, in which we replace y, by y". We thus have 
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where u: 


X — ar„ 


I ^(« + l)(« + 2)(« + 3) 

‘ 24 ^ 

or m„ 4- hu. Integrating (3) with respect to x and 

n 

remembering that dx = hdu, we have 

y' = h [uy"„ + ^ + (y + f ) A=S'"« + i (t + “' + “0 


( 4 ) 


+ 


|(|+"+i|! + 3„=).y'd + c.. 


We determine Ci from the condition that y' = y'„ when x = Xn and 

S *. *» 

therefore « = 0. On putting « = 0 and y' = y'„ in (4), we find Ci =t/'n- 
Now replacing Ci by y'n in (4) and integrating again with respect 
to X, we get 


5 , = + *= [f + I A./'. + (I + A,/'. 


/«« 

3u® 

i_ j 

11«« 

Vso ■ 

^ 10 ^ 

12 




+ c*. 


We find Cj by putting y = yn when w = 0 and thus find Cx = y„. Then 
we have 

(M J, = ,. + + J= If./’. + f A^'. + (|^ + 5) A,J". 

» t 1 /«* . 3u=> , llu« , A. ^,1 

6 \20 '^4'^3j "^”"^24 \30 10 12 "J * 

The values of y for t = and x = x„.^ are found by putting «=rl 
and u= — 1 in (5). We thus obtain 


(6) y.„ = y. + V. + J’ [1 /’. + iA,j". + ' 4,y". + ^ A.y", 

+ |i.y".] 

[I -i i.y". - A A.y". 


45 

'480 
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Adding (6) tnd (7), we get 

v.« + = 8s. + i-1 A+ i 'i.s". + ^ ^ 

Now replocing ^ ^ “o 

(8) !(.., = 8j.-y. . + i'(j". + i(A.p", + 4.y". + A.y".) 

-5^A,AI, 

which IS Stormer’s extrapolation formula for integrating ahead* 

To derive a formula for checking and correcting y,.i, we start with 
Stirling’s inletpolation fornujla with y replaced by y", namely, 

(9) = + + + f AV. ■ + 

where u = therefore dx^hdv 

Integrating (9) twice with respect to t and determining the coastanti 
of integration from the conditions / sa and y — y» when u = 0, we get 


(10) , = + li„/. [I ^ ■ 

_ u;\ Ay„ + AYV. , / JHI _ j)l.\ w.„-| 

^Vl20 36/ 2 ^^720 288/ ^ J 


+ 


Now putting « =z 1 and « = — 1 successively m (10) and adding the 
resulting equations, we obtain 


y^, = 2y, — y^, + i’fy", + ^ A '/Vi -- ^ A*/'-*) 


On changing to horizontal diBerences by means of the relation 
= A,yi.«, we finally get 


(11) v~.= 8v.-v« + A.J'V.- ^ A./'...) 


A-J(» 


• The equivalent of torrauls <a| was 8t»t used by Csrl StStmer lu 1907 Arc^*»** 

dt* Satncet pkjt$iqut$ et nslurelfea Geneve, juillet octobre 2907, p Off 
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‘ In the applications of (8) and (11) the terms — 

— neglected. Hence the working formulas are 

(112. 1) = ^Vn—yn-i + ^ (A2y"« + ^3y"n + A4y”n)] 

for finding the approximate value of and 

(112. 2) y„», = 2y„ — 1/„-, + h‘(y"n + ~ 

for checking and correcting the 2 /„,i found from (112.1). 

Formulas (112. 1) and (112, 2) give a step-by-step solution of the equation 

■j^, — f{x,y) with given initial conditions. The first is a fomula.for 

integrating ahead and finding the approximate value of yn+i by extra- 
polation. The extrapolated value is checked and corrected by (112.2). The 
starting values of y and y" are to be found by the methods given in Art. 109. 

Example. Tabulate the solution of 

^ _siny-|-l = 0, ory" = siny — 1, 

with the initial conditions y = 0.1132 and y* — 0 when s = 0. 


Solution. IVe find the first few values of y from its Taylor expansion 
about the point i =: 0. Starting with the given equation y" = sin y — 1, 
we have 

y = cos y ^ = y' cos y 
yi'- = — y'2 Bin y -f y" cos y 
y' ■ = y'" CCS y — S/y" sin y — cos y. 

Substituting in the above equations the initial values y = 0.1132, y' — O 
when I = 0, we get ^ 

y"o = sin (0.1132) — 1 = 0.112958 — 1 = — 0.88704 

y"'. = 0 

S'”’o = — 0.88704 cos (0.1132) = — 0.88704 X 0.99360 = — 0.88136 

y’^c = 0, 
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Substituting these values m the Tajlor formula 


we get 
(») 




y = 0 1 132 — 0 4435 j:* — 0 036721* 


By means of this equation (a) wc compute the y's in the first fire rovi 
of the following table Then wc substitute these y’s in the given equation 
to find the corresponding values of y" m the seventh column of the table. 
The differences A,y", A»y", Ajy" are then computed 

From this point onward we continue the computation with A = ^=005 
by means of foimnlas (112 1) and (112 2), always applying (112 1) first 
and then checking and correcting the new row by (112 2) Hence to get 
started on the siath row we apply (112 1) to the last row found by Taylofi 
aeries and get 

y, =; 2 (0 1088) — 0 1121 + ^ I— 0 SOU + ^ (— 0 0022)] 
s 0 1033 


Then we substitute this value of y« m the given equation and find 
y",s= — 0 8960 The n»th row la completed by filling in the new 
differences 

We now apply (112 2) to the new aitth row as a check on its correctness 


We have 

y, = 2(0 1088)— 0 lUl -f i [—0 8914 — ^ (0 0022)) =:0 1033 


aa before Hence we consider the aixth line to be correct The succeeding 
lines ere computed in the same way 

The differences of the y’s are not used in the computation, but th^y 
ahonld be computed as a check on Uie accuracy of the work Irregnlanlies 
in the higher differences would indicate that a mistake had been made in 
the computation 

SysAeffla ci Vn't, tbnee, tn latj iranbvi tA wrtf&’iVaTftwsft nt tie 

second order in which first derivatives are absent can be solved numerically 
by formulas eumlar to (112 1) and (112 2) Thus for a system of three 
equationa 
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^ = = 

(112 3) ■ ^ = = 

g = ^ = 

each equation la integrated eeparatel; by meana of ita ovn formula 
analogous to (112 1) Then the extrapolated raluea of x, y, a are nV 
atituted into the right hand membera of (112 3) to get t", y". at tb( 
nev point ahead Then new dillerencea are computed, and fommlu 
analogoua to (112 2) are applied to the new towa aa cbecka 

The necessary formulas for the three equations (112 3), for example 
are 

• i*., = + * (A.*". 4- A.s". + A.Z".)] 

(112 4) ■ SM.= 2y. — y^. + AV'.+ *(A.y". + A.y"- + Ay',)] 

I-, 5= 2*. — + **(«". + * (A a". + A.i", + A.*".)] 

for finding approximate raluea at the next point ahead, and 

■ I,., = 2z,— + AM®". + 

(iia 8) J. yMi=2y.— y..*+A*(y".+T4Air*.t) 
a*,i = 2*« — + 

for checking and correcting the new ralues given by (112 4) Here 
h = f.„ — t. 

Of course t may be absent from the functions the nght-hand 

members of (112 3) just as t was absent from the right hand member (d 
the equation y" = sin y — 1 

If the functions /„ f, are easy to differentiate, the first fire rilnei 
of z, 5 t needed to start the coioputation can be found from the initisl 
conditions and from the Taylor expansions of *, y, s, each as a function 
of t, if the three functions are not easy to differentiate, the beginniog 
values must be found by the Uilne method or by the modified Euler 
method, using short xotervals of t 

113 Systems of Simultaneous Equations We have already dealt with 
certain systems of simultaneous equations in leducing a second-order 
equation to two first-order equations In the present article we consider 
more general types of simultaneous equations 

ExampU Required the numerical solution of the simultaneous equation* 
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Art. 113] 


( 1 ) 


with the initial conditions a: = l,y = 2, —0, when t = 0. 

Solution. To integrate these equations numerically, we first write them 
in the forms 

(2) y = + i — sin<), 

(3) £ = y — 2i + y 4- in cos f. 

To get the starting values we use the Taylor-series method. Assume 

(4) x = To + xo<+ — +■— 4-Tr+Tr+-^ + * • • 


yot'-, y'oi^ , y\i^ ^y'M^ 


(5) y.= y,4y,e+^4^ + --^4^ 
From (2) we get 


6 ! 


+ 


y=: J(x + x — cost), y = |(x + x + sinf), etc.; 


and similarly from (3), 

x = y — 2x-f y — tant, x" = y — 2x -f- y — sec* f, etc. 

Using the initial values and putting f = 0 in the above equations, we have 


yo = l/2 

yo = Ki — 1) = — 1/4 
yo = Ki + i) =3/8 


Xo — 2 — 2 -j~ \ = 1/2 

Xo = 1/2 — 1/4 = 1/4 
= — 1/4 — 1 -j- 3/8 — 1 
= — 7/16, x"o = 9/32, 


— 15/8 


Note that these successive coefficients are found alternately by a zigzag 
procedure, starting with y, then going to x, then back to y, etc. 
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(112 3) j ^ = 

each equation >a integrated aeparately by meana of ita own fomoli 
analogous to (112 1) Then the extrapolated ralues of x, y, s are nb- 
atituted into the right hand members of (112 3) to get a:", y", r” at the 
new point ahead Then new differences are competed, and forswlis 
analogoua to (112 2) are applied to the new rows as checki 

The neoeasary formolaa for the three equations (112 3), for eumpU 
are 

• = 2x, — + A,r^. + A^'.}] 

(112 4 ) . !/«.=r2y.-y^.+V[y",+ T^(a.y", + A,y", + A,jr,)] 

*..1= 2r.— «^, + fc»[.".4'-*(At".+ A,t^.+ A.r.)l 
for finding approximate ralues at the next point ahead, and 
■ X.., = 2x. - 

(U« 8) -I y*.% = 2v,.— V.^% + A*(«r*+'^Atr~0 

**.» — 2r«—*,-» + **(*"• + ■Aa»z'Vi) 
for checking and correcting the new values given by (112 4) Here 

01 course t may be absent from the fnnctioDs fi, ft, f„ m the nght-hand 
members of (112 3) just as x was absent from the right hand member of 
the equation y" s= sin y — 1 

If the functions f„ ft, ft arc easy to differentiate, the first five vslnes 
of X, j z needed to start the computation can be found from the initisl 
conditions and from the Taylor expansions of x, y, t, each as a function 
of I, if the three functions are not easy to differentiate, the beginning 
values must be found by the Milne method or by the modified Euler 
method, using short intervals of t 

113 Systems of Simultaneous Equations We have already dealt with 
certain systems of simultaneous equations m reducing a second-order 
equation to two first-order equations la the present article we consihfr 
more general types of simultaneous equations 

ExampU Ecquired the numerical solution of the simultaneous equstions 



SYSTEMS OF SIMULTANEOUS EQUATIONS 


347 


Art. 113] 


( 1 ) 


1-^1 + *=“"' 

rfx 

with the initial conditions x = 1, t/ = 2, -^ = 0, when t = 0. 

Solution. To integrate these equations numerically, we first write them 
in the forms 

(2) y = J(a: + a; — sint), 

(3) a; = y — 2a: -f" y + In cos t. 

To get the starting values we use the Taylor-series method. Assume 

(4) « = + + + 


(5) y.= yo + yot H ^ + g , 


yo<= , y\i^ , yV® 


_L2_S1_4 

^ 4! ^ 


5! 


6! 


+ 


From (2) we get 

y = ^(i + S — cos t), y = ^(5 + '£ + sin i), etc. ; 


and similarly from (3), 

x — y — 2i + y — tan i, 


= y — 2x -\-y — sec* t, etc. 


Using the initial values and putting < = 0 in the above equations, we have 


yo = l/2 

yo = J(J-_l) =_i/4 

yo = 4(4-f i) =3/8 


rc = ~^,yve: 


37 

3 


o j y 0 — 


64 


— 2 — 2 -f- = 1/2 
i; = l/2 — 1/4= / 
i!% = — 1/4— 1 
i% = — 7/16, 


Note that these successive coeflicients are 
procedure, starting with y, then going ta 
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(112 8 ) 


1 


each equation is integrated aeparatelj bj means of its own formolt 
analogous to (112 IJ Then the extrapolated ralues of x, y, t tie inl>- 
Btituted into the right hand members of (112 3) to get ar", s" at the 
neir point ahead Then nev differences are computed, and formelu 
analogous to (112 2) are applied to the new rows as checks 
The necessary formnlaa for the three equations (112 3), for eximplt, 


are 

(112 4) 


X*., = 2x, — + -h (A**"* + 

y*., = 2y^—y^t + A*[y"» + A (A»y"» + Aiy"« + 

r*., = 2*. - t^x + hH*". + * ( A.s", + A,S". + A.*".)] 


for finding approximate raluea at the next point ahead, and 


(112 5) 


se 2*. ) 

=2y.— y^.» + 

a.., = 21, — s,.» + **(*"• 4 * ) 


for checking and correcting the new values given by (112 4) Here 

Of course t may be absent from the functions /i, /„ /», m ths ngbt-band 
members of (112 3) just as x was absent from the right hand member of 
the equation y" = sin y — 1 

If the functions /,, /, are easy to differentiate, the first five values 

of X, i, 3 needed to start the computation can be found from the initisl 
conditions and from the Taylor expansions of x, y, t, each as a function 
of t, if the three functions are not easy to diflerenliate, the beginning 
values must be found by the Jtlilne method or by the modified Euler 
method, using short intervah of t 


113 Systems of Susultaneous Equations We have already dealt with 
certain systems of simultaneous equations m reducing a second-order 
equation to two first-order equations In the present article we consider 
mote general types of simultaneoua equations 


Example Bequired the nomencal solution of the simultaneous equations 
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' dx 
dt~ 
d'x 

W 


Zil 


• 2 ^ a; = sin i 
at ' 


dy 


dl 


+ 2i — f/ = In cos t. 


with the initial conditions x — l,y — 2, — — 0, when i — 0. 

Solution. To integrate these equations numerically, we first write them 
in the forms 


(2) y = i(a;4-i — sinf), 

(3) x = y — 2x + y -}- In cos t. 

To get the starting values we use the Taylor-series method. Assume 


'ioi- 


, x'''d* , 

x\i^ 

2 

^ 3! 

‘ 4! * 

51 

yd- 

2 

, yd^ 

3! 

1- 4! ^ 

y'-'d^ 

5! 


6 ! 


6! 




+ 


From (2) we get 

y = i{x + x — cost), y = + a: -f- sin <), etc.; 

and similarly from (3), 

if = y — 2i4-y — tant, = y — 2z + y — sec* etc. 

Using tlie initial values and putting t = 0 in the above equations, we have 


jo = 1/2 

yo = i(i — 1) = — 1/4 
yo = iG + i) =3/8 


4 AY . 

i c- 


37 


IG’ 


32'^ - 


37 

64 


^0 — 2 — 2 — 1/2 
Xo = 1/2 — 1/4 = 1/4 
1% = — 1/4 — 1 + 3/8 — 1 = 
= — 7/16, s"o = 9/32. 


1. 


•f. 


15/8 


Note that these successive coefficients are found alternately by zigzag 
procedure, starting with y, then going to x, then back to y, M. 
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On substituting in (4) and (5) the coelTicienU just found, we get 


( 6 ) 

( 7 ) 


Also, from (6), 







3 

1280 


l> 


On putting t = — 0 10, — 0 05, 0 05, 0 10 in (6), (T), (8), and using 
the initial values, ve get the values of x, y, and z given in the first five lines 
of the following table The cormponding values of y and * are found 
from the given equations (2) *rd (3), by using the proper values of *, Jf, 
X and i 

The computation is continued by means of the following fonnulaa 

(9) A, = A(l + 1.4,I+A4,, + |i., + l4.,), 
for itartisg a new line, 

(10) 4i = i[i— Aiii— Ai.i— 

for finding Ar in the new hne. 


(11) y = 4(* + i — 61“ finding y m the new line, 

(12) i = y — 2x 4* y 4“ 1“ ^ fur finding S in the new line, 

(13) = 

for checking Az in the new line, all formulas to be used in the order given 

lit Conditions for ConTergenee The conditions for the convergence 
of the numerical solution by approx mating polynomials can be arrived at 
most easily by means of the Picard process 
FcSthe simple equation 
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g=y'=/(»,y) 

the Picard process conrerges to the trae iolution provided 


1 

ivi 

Idyl max 


m the region of integration , and in the case of the two simultaneou'* 
equations 

the conditions for convergence are 


At< 


w\ 



and 


At< 


1 5y [ifiex ?y I max 


in the region considered * 

Now sinbe a polynomial an be made to approximate any continuous 
function to any required degree of accuracy, it foll*)wa that the approii- 
mating polynomial used for the noinerial solution of ^ diSerential equation 
can be made to approach the Picard solution by taking h sufficiently small 
Then since the polynomial solution an be made to coincide with the Piard 
solution as closely es desired, it is evident from the geometric significance 
of partial derivatives that the conditions (or the convergence of the poly- 
nomial solution are the same as for the Picard sohition when h is suffi 
ciently small 

In the simple equation 


the numerical process of solution will fail in a region where 
dy ’ 


Tbe proof of theie conditions will be fonad in the first eq,tioB of this book 
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and in the case of simultaneous equations the process will fail in a i 
where any one of the partial derivatives 

^ ^ 9A ^ 

dx’ dx ‘ dy ’ dy 

becomes infinite. Before starting the numerical solution of a differ 
equation, it is well to examine the partial derivatives for the ran 
region to he covered. 


t 

t 

i 


i 

I 


1 




( 


HI. OTHER METHODS OF SOLVIHG DIFFERENTIAL EQUATIONS 
NUMERICALLY. 

116. Milne’s Method. A simple and reasonably accurate meth 
solving differential equations numerically has been devised by W. E. 1! 
It does not employ differences, but uses two quadrature formulas inal 
one for integrating ahead by extrapolation and the other for checkii 
extrapolated value. These formulas are derived from Newton’s fo 
(I), p. 58. 


That formula in terms of y' and u is 


(1) y' — y'o -i- uAy'o + 


u(u—l) , u(v — l)(n — 2) 

a yo-i r 


AVo 


«(« — l)(u — 2)(« — 3) . 

+ 24 + 


where u = — ^—2-, or a: = a^o -|- hu. Integrating this formula ove 
interval Xg to a:o + or « = 0 to u = 4, we have, since dx = h du, 

Ay — J^ ^dx — h^^ {y'g uAy\ -f aVo 

4- „ + u(u-l)(u-2)(.-3) ^ 

= ^(4/, + SA/ 0 + ~ AY 0 + Y AYo + II AYo) . 


Now replacing the first, second, and third differences by their values as 
on p. 48 and simplifying, we get 


* Numerical Integration of Ordinarj- Differential Equations,” American 
mati^l Monthly, yol. 33 (1920), pp. 465-400. Also. Numerical Calculus 
pp. 135-139, and Ntimcrical Solution of Differential Equatiens, 1953. 
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is = f (*»•.- s'. + V.) + § MV. 

But here Ay = y4 — y„ Hence 

(2) S. = S. + Y W.- s'. + 2s'.) + ||*i's'. 

This IS Milne’s extrapol&tion fonnule 

To get the checking formula we integrate (1) from x, to Zo + 3A, or 
from « = 0 to y = 2 Then 

4, = * (2!^. + Sis'. + J iV. - ^ W.) 

Now replacing Ay's and A*y'# by their ralues as given on p 48 we have 

is = I (s'. + V. + s'.l-^i's'.- 

But in this case Ay s y, y». Hence 

(3) s.=s.+|-<s'.+V.+s'.)-^4'y'. 

This 18 the second of the Milne formulas and » seen at once to be 
Simpson’s Buie The terms involving A*/* ere not used directly in the 
application of (2) and (3), but only aa indicators of the accnracy of the 
results 

Since Zos I he any five consecutive values of x, formulae 

(S) and (3) may be written in the more general forms 

(4) S...=S.. + y(V..-S'« + 2s'.). 

(5) S... = S..+J-(S'.. + 4S'. + S'-.). 

which are the final forms of the Milne formulas 
The principal part of the error in the value of y computed by these 
formulas 13 easily found as follows 

Let y'” and y‘ij denote the valnes of y given by (4) and (6), 
respectively Then if the value of h is andi that the inherent error m each 
formula la given by its remainder term inYolvmg aV> Ihe true value of y 
at xszxn.i 1 $ either 
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or 


Equating these values of y, we have 


';;i+Si.Ay=y';i-Kiy- 


‘ go'*"^ 90 


or 


y - siv. = -i '■^y = 29 (-4 =™- 


B+i 90"“'^ ' ' 90 

where E 2 denotes the p-t-incipal part of the error in (5). From this we get 


(6) ^ 2 — ^ y"+j)* 

This simple formula enables the computer to test the accuracy of each com- 
puted result. If we write 

(7) i) = ynn— Jln'i 

it is well to provide a column for D just to the right of the column of •/&, 
or whatever quantity is being computed; and the behavior of the D’s should 
be observed as the computation proceeds. If the D’s become erratic, look 
at once for a mistake. 

It will be observed that Milne’s method requires the four starting values 
3/n-j, y'n- 2 , y'n-i, and y'n. These values are to be found by the starting 
methods previously described in this book. Milne’s method will now be 
applied to three types of differential equations. 

(a) Equadoiis of the First Order. To tabulate the solution of the ffrst- 
order equation 

(a) ^ — 


we first find three consecutive values of y and y' in addition to the initial 
values. Then we find the next value of y by (4), substitute this in (a) 
for the new •/, and then substitute the new y' in (5) to get the corrected 
value of the new y. If the corrected value agrees closely with the extrap- 
olated value, proceed to the ne.vt interval. 

If the corrected value differs appreciably from the extrapolated value, and 
no error can be found in the work, compute i?; by (6). If is too small 
to affect the last digit to be retained, all is well; proceed to the next interval. 
But if E: is large enough to affect the last figure to be retained, the value 
of h is too large and must be reduced. 
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Example 1 Tabulate by method tbe numeTical solulicm ol 

■S-i+y. 

With 

ia — 0, y, = l 

Solution On page 324 we found the starting values given in the first 
four lines of the accompanying table To start the fifth line we have by (4) 


10000 
1 1103 
1242S 
U997 
1 5830 
17074 


1 0000 
12103 
1 4428 
1 0007 
1 0830 
22074 


yo4 = 1 + ^ [2(1 2103) — 1 4428 + 2(1 6997)] 
= 1 6836 


Then 


y'«*ss04 + 15836 = 19836 


Now checking ya 4 by (6), we have 

ya 4 = 1 2428 [1 4426 + 4(1 $997) + 1 9836] = 1 5836 

which IS the eame value of y«4 as found by (4) Hence we consider it 
correct '• 

Proceeding now to the next line, we have by (4) 

y* , = 1 1103 4- ^ [2( 1 4428) — 1 6997 + 2(1 9836)] a= 1 7974 
Then 

/g , = 1 7974 + 05 = 2 2974 
Now checking by (6), 

y,, = 1 399r + ^Cl 6997 + 4(19836) +2 2974] = 1 7974, 

which is the same value of yg » as previously found 

(h) Eguattonj of the Second Order Since formulas (4) and (5) are 
merely relations between a function and its derivative, sim lar formulas 
hold when the function is y' Hence we may write 

= y'» . + ~ (2y"„ -y'V. + 2y".) 


( 8 ) 
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(9) y'nn = y «-i + 1 + y"n*i) • 

The general equation of the second order, when solved for ^ , may- 
be written in the symbolic form 
(b) = 

When four starting values of y and y' have been found by some method, 
the solution is continued as follows: 

1. Use (8) to find a first approximation to the new y'. 

2. Substitute this new y' in (5) to get a new y. 

3. Substitute in the given equation (b) the new y and new y' to get an 
approximation to y", 

4. Check the new y' by (9), using the new y" just found. 

6. If the y' just found by (9) does not agree with that first found by 

(8), substitute the corrected y' in (5) to get a corrected y. 

\ 

6. Then substitute in (b) the corrected y and y' to find a corrected y". 

7. Substitute this corrected y" in (9) to get a better y', and then 
substitute this last /in (5) to get a better y. 

8. As a final check, apply (6) to the last two consecutive y'^s and y's. 
If the error is too great, decrease h. 

Example. Compute by Milne’s method the last line of the table on 
page 339. 

Solution. Substituting in (8) the appropriate values of 6 and $, we have 
= 0 + ^ (— 5.782 4- 2.'>58 — 5.120) = — 0.5429. 

Now substituting this €s in (5), we get 

e, == 0.2854 + ^ (~ 0.2879 — 1.6844 — 0.5429) = 0.2435. 

Then substituting 6^ and 0* in the given equation 6 = — 0.20 — 10 sin 0, 
we get 

05 = 0.1086 — 2.4110 = — 2.3024. 

As a check on 0j we next use (9) with the 0^ just computed. We have 

1 
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which agrees with the ralue previooslj found We therefore tahe these 
Tallies to be correct 

The reader will rote that formula (8) was used only once, and would 
not have been used again eren if the two values of 6 had not agreed on 
the first round 

(c) fi'tmultoneous EquaUona The solution of simultaneous equations 
by Milne’s method can be explained beat by an example 
Example S Compute by Milne's method the values of x, x, y, and y 
in the seventh line of the table on p 349 
5oZ«Jt(jn We first find r» by means of formnla (8) Thus, 

I, — 0 4- ~ [2(0 5102) —0 5156 + 2(0 5162)] = 0 1025 
Kow using thia.Talue of x m (5), ve get 

I, = I 0025 + ^ (0 0509 + 4(0 0767) + 0 1025] a= 1 0102 

Substituting these valoea of x end x in the given equation ya:^(z+^ 
— smOi ^th < = 02, w« have 

y, = i(l 0102 + 0 1025 — 0 1987) — 0 4570 
Now nsing (5) to find y, we have 

y, = 2 0488 + ~ [0 4768 + 4(0 4665) ) + 0 4570] = 2 0955 

We next substitute in the given equation x = y — 2* + y + liicos< the 
values of x, y, and y found above, with t = 0 2 Then we get z =: 0 5120 
Finally, we check the whole procedure by means of (9) We thus have 

x, = C 0509 + [0 5136 + 4(0 6162) + 0 5120] = 0 102» 

Since this value differs from the extrapolated value by only one unit in 
the last figure, we take it sa correct 

Additional lines of the table can be computed by exactly the same pro- 
cedure as employed above 

The reader will note that the values found by Milne’s method are 
the same as those found by the difference method, formulas (108 1) and 

118. The Runge-Eutta Method Hus method was devised by Hunge * 
* C. Range UalhemsIucAe Aneaien, Vol 48 (1695J 
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about the je&r 1894 and extended by Kutta f a few years later. It is 
unlike any of the methods explained in the preceding pages. Here the 
increments of the function (or functions) are calculated once for all by 
means of a definite set of formulas. The calculations for the first incre- 
ment, for example, are exactly the same as for any other increment. 

The formulas for several types of differential equations are given below. 

(a) First-Order Equations. Let dy/dx = f{x,y) represent any first- 
order equation, and let h denote the interval between equidistant values of 
X. Then if the initial values are Xo, yo, the first increment in y is computed 
from the formulas 

lci=if(xo,yo)h, 

^2~f (^0 + yo + 

~ f (^0 + "2 > yo "i" 

hi = f{xo-\-h, yo-{-h)h, 

Ay ~ “ 1 " 2^2 -|- 2 fca hi), 

taken in the order given. Then 

Si = ffo + h, = yo 4* Ay- 

The increment in y for the second interval is computed in a similar 
manner by means of the formulas 

yi)A, 

= / ^Si , y» 

+ 2’ 

— f {Xi -}- 7i, yi -}- IC 3 ) h, 

Ay = ^(^1 4 “ 2^2 -f- ZJci 4- fei), 

and so on for the succeeding intervals. 

It will be noticed that the only change in the formulas for the different 
internals is in the values of x and y to be substituted. Thus, to find Ay 
in the nth interval we should have to substitute x„.i, yn-i, in the expressions 
for hi, hi, etc. 

In the special case where dy/dx is a function of x alone the Eunge- 
Kutta method reduces to Simpson’s Eule. For if dy/dx = f{x), then 
t W. Kutta, Zcitsckrift /ur Math, und Phjfs., Vol. 46 (1901). 
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and therefore 

As = A [/(r.) + 2/ (i. + 1) + 2/ i + A)] 

= ^[/(r.) +•!;(». + 1) +/(>. + M] . 

vhlch IS the same result as would be obtained by applying Simpson’s Bole 
to the interral from to ^ ^he two equal subinterrals of 

width h/2 

(b) Steoni Order E^luttu of the general type 
y" = /(t,y,Sr') 

are integrated step by step by means of the following fonnnlas, applied 
in the Older giren. 

l. = Wx. + |. + + 

i. = w*. + |. 2.+|/.+ti.. y-.+l’), 

t. = V(^. + *. ». + »/. + 5-1., s'. + M, 

Ay = J[jr'. + |-(t, + l. + i:.)], 

A/=|-(l.+Sl. + 2K + h). 

For the special second>order equation 

< = /{ir,y). 
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— ^fi^} Vn)} 

fc, = + I" > + + 

^2^ _ hs = hfiXr. + h, yn + hy^n + 

Ay = h[y ' B 4" ^ (^ 1 4" ^^ 2 )], 

Ay' = g (fci 4* 4^2 4- ^ 3 ) • 

(c) Simultaneous Equations. In a pair of simple simultaneous equations 
of the tj’pe 

^ = fi{t,x,y) 

^=U{i,x,y) 

the increments in x and y for the first interval are found from the 
foUovring formulas: 

' fci =/i(to,a:o, yo)At, 

“ A ^*0 4" > 2:0 4- j yo 4" 

fes'=A^A4-Y'’ yo4-^^^A 

= A(A 4" ^ 0 4" ^s> yo 4" A) At, 

^ As = 4” 4" 4~ ^«)* 

(4) 

' h = Uito,Xo,yo)M, 

A = A^to4--^, so4-y, yo4-|-^^A 

A = A^A4--^j so4-y, yo4-^^A<, 

A = A (A 4" At, So 4" ^sj yo 4~ A) At, 

. Ay = i(A4-2A4-2A4-A). 

The increments for the succeeding intervals are computed in exactly tiio 
same vray except that to, loj-yo a.re replaced by tj, s^, y^, etc. as ivs proceed. 
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The simultaneous equations 

are solved bj formulas (4) b; changing ( to z, z to y, y to z, and 
putting Ai = k 

The derivation of the formulas used m the Punge Kutta method u s 
somewhat lengthy process and mil not be given here * 

The inherent error m the Pttnge EntU method is not easy to estimate, 
but IS of the order A* \ and is therefore of the same order as that in 
Simpson’s Rule 

We shall illustrate the method by applying it to an example to which 
the previoua methods were applied. 

Example Solve the equation 



mth the initial conditions Zs s 0, y« =: 1 
iSolutton Taking A s 0 1, we have 

k, =s01Xls=01, 
i,ss01[005 + 105] — Oil, 

ss 0 1(0 05+ 1 055] =: 0 1105, 

l, ss 0 ICO I + 1 H05] := 0 12106 

Ay cs ^ [0 1 + 0 22 + 0 221 + 0 12105] = 0 11034 
Hence z, =z z, + A = 0 1, y, = y, + Ay = 1 + C 1103 = 11103. 

Then for the second interval we have 

A, = 0 1(0 1 + 1 1103) = 0 12103, 

A, — 0 1 (0 1 + 0 05 + 1 1103 + 0 06051) = 0 13208, 

A, = 0 1 (0 1 + 0 05 + 1 1103 + 0 06604) = 0 13263, 
A*s=Ql(0l + 01 + l 1103 + 0 13268) = 0 14429 
Ay := i (0 12103 + 0 26416 + 0 26526 + 0 14429) =: 0 13246, 

* See KntU loo etl or 2f«fnrruehet RecHim by C Rungt H Sfinlg pp 287 
»« apd 311 313 

t See KutU ioe ctl or yummeoftz /olesretton by F A. Willen pp SI S2 
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CHECKS, ERRORS, AND ACCURACY 

and I. = 0.2, y, = 1.1103 + 0.1325 = 1.2428. These valnes for y, and y^ 
are correct to four decimal places. The computation can be continued in 
this manner as far as desired. 

117. Checks, Errors, and Accuracy. Attention has already been called 
tc the use of formulas (108. 2), (108. 3), (108. 4), and (108. 5) for checking 
the computed change in a function over a single interval. A formula has 
also been given for checking the results found by Milne s method.^ Simpson s 
Kule furnishes a convenient and reliable means of checking the summation 
of any function over an ev'en number of intervals. For example, the 
decrease in the horizontal velocity of the bullet in the example of Art. 121, 
from t = 2 to < = 26, is 

Ai = ^ xdt 
or 

— §[_ 19.52 -f 4 (— 16.26 — 11.88 — 9.43 — 8.27 — 7.91 — 7.88) 

+ 2 (— 13.77 — 10.46 — 8.72 — 8.02 — 7.88) — 7.90) = — 247.76. 

Hence 

= 567.32 — 247.76 = 319.56, 

which differs from the value in the table by only two units in the last digit. 
The fifth figure in all these numbers is uncertain, probably worthless, but 
the two methods certainly check within a unit in the fourth figure. The 
values of y and y may be checked in a similar manner. 

A single error in any one of the quantities x, y, and y will persist 
throughout the computation in the column in which it occurs, but its 
eSect will usually not increase as the computation continues. An error 
in the acceleration will likewise persist and will affect in some degree all 
the other computed quantities, but the effect may not be serious. An 
error in the differences of the acceleration and in the second, third, and 
fourth differences of the other functions will soon disappear, and its effect 
on the final results will usually be negligible. If several errors are made, 
they will probably neutralize one another to a considerable extent, but it 
is possible that they may accumulate sufficiently to affect seriously some 
of the later results. 

As an e.xample of the effect of a single error near the beginning of a 
computation, it may be stated that the example of Art. Ill was first com- 
puted tliroughout by starting witli an error of two units in the last digit 


— [5; 4(X4 Xg Xl6 -j- X2Q -f- ^ 24 ) 

3 

-}- 2(£g -J- Xio -j- a:, 4 Xis -}- X22) -{- 
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of S for I = 0 05 Bee The maxunum error in any subsequent value of 
0 up to ( = 2 1 was five units la the last digit, whereas the greatest error 
in any later value of ff and 6 was ooly two units m the last figure 

An error of more than a unit in the last digit of a computed result 
can usually be detected by inspecbon of the second, third, and fourth 
differences of that result If these higher differences run smoothly — 
that IS, vary in a regular fashion without sudden changes in magnitude 
or sign — , it IS quite certain that no error has been made, but if tbe 
third and fourth differences become grossly irregular, tne student had 
better stop and look for an error at once The error may be located 
approximately by the method explained m Art 17 The computer should 
watch the behavior of the higher differences as he goes along, bo as to 
detect an error as soon as possible after it appears 

The safest plan to insure accuracy is to take h bo small tliat fourth 
differences will be negligible to the number of hgurea desired m the final 
results When fourth differences are negligible, the application of formula 
(108 2) as many times as it will effect improTement will usually inscrs 
that the error is less than half a unit iii the last figure retained Since 
these halt'Unit (or less) errors are as likely to be positive as negative, 
they are largely neutralised m the calculation process Hence it is not 
worth while to consider them in eetimatiog the tccaracj of a final result 

Mhatever method is used in tabulating the nume'ical solution of a 
differential equation or a system of equations, the successive differences of 
all computed quantities should be computed and recorded The behavior 
of the differences will show at a glance whether a mistake has been made 
in the computation or whether the value of h is too large 

116. Some General Remarks Tbe methods pven in the preceding pages 
are believed to be sufficient for the numerical solution of all ordinary 
differential equations having numerical coeHlcients and sufficient initial 
conditions Equations higher than the second order have not been treated, 
but equations of the third and fourth orders can be handled by the methods 
given All that has to be remembered is that formulas for integrating 
a/iead and starting a new line are to be applied to the denvahve of 
highest order tn the equation (or equations) and the lanous differences 
of that highest order derivative 

The most important matter in tbe numerical solution of a differential 
equation is getting correct starting values These can be found by 
several methods, but in some of them there is no certain means of deter* 
mining the accuracy of the results found When the starting values are 
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found by the modified Euler method, the value of h should be so small 
that one or two repetitions of the averaging process will give the final 
result for that value of li. Likewise, when the starting values are found 
by Taylor’s series, h should be so small that only three or four terms of 
the series have any effect on the computed result. 

Reliable starting values can be found by the Eunge-Kutta method in 
many cases, but usually at a greater e.xpenditure of labor than by other 
methods. 

The Jlilne method of finding starting values is accurate and reasonably 
short. When the derivative of the given highest derivative can be found 
without difficulty, this is a good method for computing the starting values. 

After correct starting values have been found, there are two good methods 
for continuing the computation : the method employing differences, formulas 
(108. 1) and (108. 2) for e.xample, and the method of Milne. Which of these 
is preferable probably depends on the taste and equipment of the computer. 
In the difference method much of the work can be done mentally and with 
very little effort. On the other hand, if the computer is equipped with a 
computing machine and is expert in using it, he may find the Milne 
method shorter and easier. 


The Eunge-Kutta method is too laborious for tabulating many steps of 
a numerical solution. 

The Picard method gives the solution theoretically , when the derivative 
is any type of function, but the method is of limited practical value 
because of the difficulty frequently encountered in performing the required 
successive integrations. 

The reader has observed that the numerical solution of a differential 
equation by any method involves considerable labor. But the numerical 
methods also have certain redeeming features in their favor ; for they pro- 
vide a means of obtaining solutions to problems which could not be solved 
otherwise, and they also give a complete record of the behavior of the 
functions within the regions considered. In some problems the exact 
analytical solution may involve more, labor than the numerical method if 
certain information is desired. The following example will illustrate this 
point. 

Suppose the differential equation 

dy ^ y — ar 
dx y + 1 

is given, with initial conditions lo = Q,yo — 1, and it is required to find 
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several corresponding \alue5 of » and y The given equation can be solved 
b 7 putting if — vx, separating the variables, and integrating The result, 
for the gnen initial conditions, la 

I In (i* + y*) + tan ‘ | 

To find pairs of corresponding values of x and y from this equation we 
could substitute the desired values of x and then solve the resulting equation 
for y But this resulting equation will always be a complicated transcen 
dental equation which can be solved only by trial — by Newton's method 
or otherwise The labor of solving this equation for even a single value 
of y would probably be as great as that of computing several tabular values 
by numerical integration The numerical method might therefore be the 
easier in this eiample 

The numerical solution of a differential equation, however, will give no 
information cbncerning the function outside the range of computed values, 
whereas the exact analytical solution will enable us to predict the behavior 
of the function for any values whatever of the independent variable For 
this reason the solutions of differential equations expressing natural phe- 
nomena should always be obtained in analytical form if possible 


EXERCISES XIT 

1. Solve the simultaneous equations 

g = + = ,_3,, 

With the initial conditions x = 0, y =: 0 S when issO Compute the first 
SIX lines of a tabular solution 
2 Compute the first six lines of a tabular solution of 
dff 


dt 

ino^. 


with the initial conditions $ = 30”, f = 0 

3 Use the method of \rt 112 to eohe the equation 
7 0 9 am 9 = 0, 


di‘ ■ 


. d9 


with ttie initial conditions B = 5”, when f = 0 Tabulate the first 

siz lines of the solution 
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4. Use the method of i\rt. Ill to solve 


d'r 

Ip 


0.0002959 


+ 0.01 



with the initial conditions r = 1, — 0, when t — 0. Compute the first 

six lines of a tabular solution. 

5. Compute the first ten lines of a tabular solution of the simultaneous 
equations 

d-x _ 0.0002959X 

W~~ ’ 

d-y 0.0002959y 
dP^^ r’ 


with the initial conditions x = 0.31, y = 0, — — ^ — 0.034, when 

t = 0. Here r = y/ x- ■{• y'^. 

A'/vOjIixir- 

IV. THE DIFFERENTIAL EQUATIONS OF EXTERIOR B^LISTICS. 

119. The Simplest Case — Flat Earth with Constant Acceleration of 
Gravity. This book is not primarily concerned with the derivations of 
differential equations, but inasmuch as one of the main fields of application 
of numerical integration to the solution of differential equations is that 
of exterior ballistics — the science which deals with the motion of a pro- 
jectile after it leaves the gun — , it seems not amiss to sketch briefly the 
derivation of the fundamental differential equations of the motion of pro- 
jectiles. The projectile will be considered as a material particle acted on 
by the force of gravity and by a tangential retarding force due to the 
resistance of the air. In the present article the acceleration of gravity will 
be assumed constant in magnitude and direction, which means that w'e are 
assuming a flat earth and that the projectile does not reach a great height. 
The air resistance is proportional to some (variable) power of the velocity, 
which power itself depends on the velocity. The equations will be derived 
first by taking 0 as the independent variable and then by taking time (f) 
as the independent variable. 


Case I. Taking 6 as ihe Independent Farioble. Let a projectile of 
weight ir be fired with an initial velocitj* Vo at an angle of elevation ip; 
let V denote the velocity of the projectile at any point in its path and let 
0 denote the inclination of the velocity vector at that point; and, finally, 
let p denote the radius of curvature of the trajectory (path) at the point 
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in question and let lev" denote the air resistance at that point Then 
resolving forces along the tangent and the normal at P (see tig 17), 
we have by the fundamental law oi dynamics 


(1) 

11 

J 

7 

(2) 

— ^ ]V c(a d = 

P p 
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Equating the values of ds from (3) and (4) and simplifying slightly, 
we obtain 

fU) ^ — r Ian 0 = c r"*’ sec 

where c = A-/ir. 

This equation (o) is frequently called the fundamental equation of 
exterior !)allistics. When n is an integer, the equation becomes the well- 
known Bernoulli type of linear differential equation and can be solved for 
V as a function of 6. 

The values of the exponent n for various velocities are as given below : 

0 < u < 790 ft./sec., n = 2 
790 < t; < 970 ft./sec., n = 3 
970 < r < 1230 ft./sec., n=5 
1230 <v < 1370 ft./sec., n = S 
1370 <v < 1800 ft./sec., n = 2 
1800 < V < 2600 ft./sec., n = 1.7 
2600 < V < 3600 ft./sec., n = 1.55. 


For n — 2 and the initial conditions 6 = <jy, v = Vo, the solution of 
(5) is 

(119.1) -4- = ccos*0 Fsec^tan^ — sec tan ^ In 

|_ Y T- secS-ftan0j 

cos-g 
Vo® cos* ^ " 


To find in terms of 6 the rectangular coordinates of any point on the 
trajectory and the time of flight of the projectile, we have 


dx 

de 

dy 

de 

a 

de 


: p cos = 


dx ds 
' ds de 
dy ds . „ 

’ds'd6~v^^'' 


v~ 

9 ’ 

„ sin e 

pCos9 • 

cos^ 

P V 


V 

■ tan e . 

9 


Integrating these three expressions from 0 = <^> to 6 = 6, we get 
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(119 2) 


9J* 

1 fV 

sJ* 

(= — - r*r; 

ffJ* 


Thes« integrals can be computed b; Simpson’s Buie as soon as the values 
of the integrands are known for equidistant values of 6 In the case n — Z 
the values of ti can be found from (119 1) 


Case II Taixnff Tme (t) as the Independent VaruiJIe In most 
ballistic calculations it is better to take time as the independent variable 
To find the differential equations of motion for this case we resolve forces 
in the horizontal and vertical directions Then (see Fig 17) 


— tv'cosdss — i 

9 

— kv* sm $ — H = — y. 


ys3 — ^v^sin^ — jss — Bsin^ — p = - 


where Hence the fundamental differential equations in rect 

angular form are 


(119 3) 



V 


9 


These equations are connected by the velocity v = V®* + y* and must 
therefore be integrated aimultaneously 

120 The General Case, Allowing for Varution m Air Density with 
Altitude The ballistic equations thus far given do not permit the decrease 
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in air resistance and gravity with altitude to be taken into account and are 
therefore inadequate for modern gunnery. To allow for variation in air 
density with altitude it has been the practice in this country to write the 
fundamental diSerential equations in the forms;* 

( 120 . 1 ) — — 

where 

„ G(v)H(y) 

^ = — c ■ 

Here G{v) is a function of the velocity alone, E {y) is a function of the 
altitude alone, and C is a constant whose value depends on the weight and 
shape of the projectile. The function H{y) is 


H (^y) — ]^Q-0.000045j; — g-0. 0001036]/ 


when the altitude y is in meters. The function G{v) is much more com- 
plicated. These functions G{v) and H{y) have been tabulated for a wide 
range of values of v and y.f 

121. Methods of Finding the Starting Values. The use of Taylor’s 
series in starting the computation of a trajectory by numerical integration 
is out of the question, because of the difficulty in finding successive deriva- 
ties of the given differential equations. The Ruuge-Kutta method is 
likewise unsuitable for obtaining the necessary starting values. The Milne 
method can be used for the simple problems not requiring the i^-function, 
but in the general case of projectiles fired with high velocities and reaching 
considerable heights, the starting values must be found by one of the 
following methods : 

(a). The Modified Euler Method. This method, as previously stated, 
will give starting values in any problem, provided short steps (intervals) 
are taken. In starting the computation of a trajectory, two consecutive 
values of the required functions, in addition to the initial values, are com- 
puted by taking very short intervals of time. From these three values 
first and second differences arc formed. Then the computation is con- 
tinued by means of formulas (108. 1) and (108.2). After the first five 
values are found, they are checked by formulas (108. 3), (108. 4),'and (108.5). 


J See Tables la and Ic in Exterior Ballistic Tables Based on Numerical Integration 
Vol. I, WnshinRton, 1924. 

’ The reduction of tlie ballistic equations to the form (120. 1) and the integration 
of them numerically vss first done by F. R. Moulton. 
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(6) Barkers Ili/perboUe Are Uetkod In recent years a new and 
entirely different method of starting the computation of trajectories has 
been devised by J E Barker • Having in mind the fact that the path 
of a proj»ctile fired through the air has a vertical asymptote at no great 
distance from the gun (usually at a distance of two to three times the 
horizontal range), Barker conceived the idea of replacing the trajectory 
near the origin by the arc of a hyperbola pas«ing through the origin and 
having a vertical asymptote at a hortrontal distance c from the origin 
The equation of such a hyperbola is of the form 

(I) 

where a b, and c are undetermined parameters These parameters are 
to be determined by the condition that the hyperbola shall have third-order 

contact Mith the trajectory at the origin This means that ~ and 
^^*for tlio liyjcrbola must equal the same three derivatives of the tra 
jectory at the origin The hyperbola will then approximate the trajectory 
extremely closely in the neighborhood of the origin and may therefore be 
used for computing starting values for the trajectory in that region 
From (1) ue get by differentiation 

( du _ gacr + he — az* 
dx~’ (c — a:)* ’ 

/g. <f y _ 2ac* + 26c 

' ‘dr*” (c — »)• ’ 

d'y 6e(oc + h) 

. dz’ “ (c — x)* 


To find the corresponding denvatives of the trajectory, we have 


Mtthematician at the U ^Naval FroviDg Ground* Dablgren, Va 
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_ ds ds/dt V 

But since P =:ie"^Wdi ~ 6 ^ ana p-- 


Also, 


V- 


g cos 6 
d-y _ 


from which 6 sec 6 = ■ 


g cos 6 
Hence 


by Art. 119, we have 


V 

9 


dx- 

£y 

dx^ 


V X cos 6 


iv cos 0 


_L 

XVx 


X- 


d { g\ d . dt 

„ X 2g(—Ex) _ 2gE 

X* - x^ 


= 2gx~^ ■ X • — 


1 

X 


Now equating these three derivatives to the corresponding derivatives 
in (2), putting i = 0, x = Xo, 0 = <p, E = Eo, and then solving the 
resulting equations for a, h, and c, we get 


and 


■==11- 


On substituting these values in (1) we get y in terms of x. 

But since the independent variable in the ballistic equations is t, we 
must have x and y in terms of t. To get the required relations we go 
back to the relations 

dry 2c(ac -V h) g 


dx- 


{c~xY 


X- 


Solving for x, separating the variables, and integrating, we have 

V — 2c(ac-l-6) C {c — x)-^l^dx — ^/g T dt. 

J 0 »/o 


From this we find 


= '[‘-( 77 ^ 


2V— 2(ac + fe) 




+ 2V— 2(ac+ 6) 

■Reducing the right-hand member to its simplest form and then replacing 
a, b, and c by their values as previously found, we get 


3xo i {Eat -f- 6) 

~ 2 ■ {Eot + sy 


=f[ 


3t 


Fot + 3 ' (A?ot4-3) 




(3) 
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When this value of z le subsbtnted in (1), the value of y becomes 

>'=s 

which IS equivalent to 


f4) y=-^(f?,< + 3)* + 


9y fi^«ya 


27(3y-f 

8i:*,(£.< + 3)» 


Differentiating (3) with respect to ( and simplifying we g?' 


(1211) i = i.(l-r~V 

which may be written as the binomial eeries 

(iai2) * = *.[l-(iP.I)+|(£.0’-||(i(.l)‘ + ^ (B.0‘ ] 


On differentiating (4) with respect to t, we find 

'=~^(‘+¥)+^(‘+^)+''*l*+¥) 

In view of (121 1) and the fact that y*/ia = Uni^ the third term on the 
right IS equal to rtan^ Then on replacing the middle term by its 
binomial expansion and reducing the right band member to its simplest 
form we get 

(121 3) y = xtan«— y<[l — (1/2H£'.0+ (5/18)(£o<)’— (5/36)(F»f)’ 

+ 1 

From (121 1 ) or (121 8) s is readily found Then this value of x is 
used m (121 3) to find y Formula (4) is not convenient for finding y 
When the values of y yi and y^ have been computed by means of (121 3) 
the values of y are more easily fonnd from the quadrature formulas 

[ ui = u,— (9» , + ISuo — 5«i + ii,) 

U,=lUo » \ -V Wtll» + tl,) 11,^ 

. At 


{\ 1 \ 4> 
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where w stands for any TariablCj u its time derivative^ and Af(= h) is the 
interval between equidistant values of t. Note that i in (121. 1), (121. 2), 
and (121. 3) may be either positive or negative, but At in (121. 4) is always 
positive. 

The values of i and y found from ( 121 . 1), (121. 2), and (121.3) are 
extremely accurate, but they can usually be slightly improved by iteration 
by means of formulas (121.4). The computation of a trajectory is started 
by the Barker method as follows: 

Close approximations to i-x, ii, it and y.,, yi. yt are first found by means 
of (121.1) and (121.3), using t = — M, t = M, t = 2Af. These f’s and 
i/’s are then substituted in the given differential equations (120. 1) to get x.x, 

X;, and y.,, y,, yj. Tlien these x’s and y’s are substituted in the right- 
hand members of (121.4) to get improved values of x.,, x,, x-, and y.i, yi, 
y.. If there is any reason for thinking that these last values can be 
improved, the iteration process through (120.1) and (121.4) is repeated. 

IVhen the final values of y.i, yi, and y- have been found, they are sub- 
stituted in the right-hand members of (121.4) to get the values of y.i, 
yi, y;. If the values of x.i, x,, x- are desired, they can be found in a 
similar manner. 

When two or three sets of values of the several quantities mentioned 
above have been found by the process outlined, differences up to the second 
or third order will.be available. The computation is then continued by 
means of the difference formulas (108.1) and (108.2). The application 
of the Barker method to a simple trajectory will be shown below. 

The actual computation of a modern high-altitude trajectory cannot be 
given here, because of lack of space for the necessary tables. The reader 
will find such a problem worked out completely in the Encyclopedia 
Brifannica, Twelfth Edition (1922), Vol. XXX, p. 390, A simple trajec- 
tory will be worked out below. 

Note. Since the advent of high-altitude rockets, the motion of projectiles 
in a vacuum has become of practical importance. A simple and direct 
treatment of this astro-ballistic problem will be found in the following 
paper. The Actual Path of a Projectile in a Vacuum,” AmeTican Journal 
of Physicit, Yol. 13, No. 4 (August, 1945), pp. 253-255. 

A thorough and masterly treatment of the motion of projectiles and 
rockets under all conditions will be found in Ballistics of the Future, bv 
Kooy and Uytenbogaart, 1S4G. 

XxamyJe. A bullet is fired at an angle of 38° 30' with the horison and 
'nith an initial velocity of 780 feet per second. Assuming that the air 
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resistance xanes as the square of the Telocity of the bullet and that the 
resistance coefficient is — 0 00005, find the range, time of flight, and angle 
of fall of the bullet 

SotiiUon Let 0 denote the angle which the Telocity rector makes with 
the honzontal at an} instant Then the equations of motion are 

^ = — fleosfl= — 0 00005c* cos 0, 

= — i2am0 — g-= — 0 OOOOSv* sin 0 — g, 

where i2(= 0 OOOOSv*) denotes the tangential retardation Since vcos0 
= V, = dz/di and v sin d = v, = dg/dl, the equations of motion can be 
written in the form 

d^x dx 

-j:z =r — 0 00005c -37 , 
at* dt 

*=- 000005 .^-? 


These can he reduced to a system of first-order equations by putting 


. dx m ^ 

^ = 7!' ‘ = Tr 


dt*‘ ^ dt^di* 


Taking ^ as 33 16 ft /sec *, we then have the ^stem 


=y = — OOOOOSsy — 3216 


To start the numerical solution ol this system of equations we first 
find the initial salues of the yelocities and accelerations Thus, 


V, = 780, 

Xo = V. cos 38“ Z(f = 610 44, 
y, = v« Bin 38“ 30* = 485 56, 

Xo = — 0 OOOOScA = — 33 81, 

yo = — 0 OOOOScoy, — 33 16 =; — 61 10 
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Thc?c quantities give the first line in the table to be comjmteel (page 382). 

To find additional starting values in this example by the Taylor-series 
method is out of the question, because of the difficulty in. finding the higher 
derivatives of the given equations. But since the derivative of 


x = — 0.0000oiVi‘ + F is 

^ 2xx^ -}- gyy 


X = — 0.00005 






) 


and a similar expression for y, the starting values could he found by the 
Milne method. However, for the purpose of illustrating the methods, we 
shall find the second and third lines of the table first by the modified 
Euler method and then by the Barker method. 


(a). Modified Euler Method. To find the second line of the table on 
page 382 by the modified Euler method, we assume that the initial accelera- 
tions will remain practically constant for the next 1/4 second. Hence 


Ay •= ;J(— 51.10) = — 12.78, 
Az = :i(— 23.81) 6.96; 


and therefore 

= yo + Ay rr 485.66 — 12.78 = 472.78, 

= fo + Ai =r 610.44 — 5.95 = 604.49. 

Since v= Vi* + yS "'ve have 

= V (604.49)"-!- (472.78)* = 767.42. 

Then 

yi//=’ = — 0.00005 X 767.42 X 472.78 — 32.16 = — 50.30. 
= — 0.00005 X 767.42 X 604.49 = — 23.19. 

Better values for Ay and Af are therefore 



( 

( 


— 51.10 — 50.30 

2 

— 23.81 — 23.19 

2 


) 

) 


= — 12 . 68 , 
= — 5.88. 


= 485.56 — 12.68 = 472.88, 
ii/4'"’ = 610.44 — 5.88 = 604.56, 

= V (604.56)" (472.88)" = 767.53. 
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The third approximations for the accelerations at the end of the intenral 
are then 

y^,(*l=_50 31, 

*,/.**»= — 23 20 

These values differ from the preceding values by only one unit in the 
last digit and will give the same values of i and y as before Hence we 
take them as correct for the present 
To find the value of y when f sis we have 

y,/. — 0 + 119 80s:: 119 80 

The values are now known for the second line in the table 

To find the third line we assume that the acceleration at the end of 
the first ^ second will remain practically constant for the next j second 
Hence we have 

(A®),rt'‘»rsJ(--2320)=— 580 
(Ay)irt<“ = l(--50 31) = — 12 58 
Then 

(i),/,‘» = 604 56— 5 80 = 5''8 76 
= 472 88 — 12 SS = 460 30 
= V (698 76)* + (460.30)* = 765 24, 

(3r),/,l» = — 0 00005(598 76 X 755 24) ss — 22 61 
(y) = — 0 00005 (460 30 X 755 24) — 32 16 = — 49 54 
Better values for Ax and Ay are now 

Hence 

(i),/j‘*) = 604 56 — 5 73 = 598 83 
(y) •/*'*’ — 472 88 ~ 12 48 = 460 40 
(«),/,<*> = V (598 83)* + (460 40)* =: 755 36 

Then 

(x) ,/,‘'> =- 0 00005(598 83 X 756 36) =_22 62 

(y) ,/i"> s= — 000005(460 40 X 755 36) = — 49 55 
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These values differ from the preceding values by only one unit in the last 
figure, and they give the same new values for bs and Ay. Hence we con- 
sider them correct for the present. The increment in y for the second 
interval is 

1 / 472.88 -f-460.40^ 

''*' = 41 2 j = 116.66. 


Hence the nevr value of y is 

y,/, = 119.80 + 116.66 = 236.46. 

(b). Barker Method. To find the second and third lines of the table 
by the Barker method we first note that 


and 


Ho = 0.00006 X 780 = 0.039 
tan <^ = 0.79544 


Then on substituting f ■= — ^ in (121. 1) or (121. 2) we get = 616.43. 
How substituting in (121.3) this value of i.i and i = — we get 
y.i = 49S.41. The value of is then 


u.i = V (616.43)* + (498.41)* -=■ 792.72. 


These values are no^v substituted in the given equations to get the corre- 
sponding accelerations. Thus, 


5-1 = 
y-i = 


792.72 X 616.43 

20,000 

792.72 X 498.41 

20,000 


24.43, 


32.16=- 


61.91. 


These quantities are placed in the first line of the trial table (Table A, 
p. 379). The quantities in the third and fourth lines of Table A are found 
in exactly the same manner by substituting t = and i = respectively, 
in formulas (121.1) and (121.3) or in (121.2) and (121.3). 

IVe next check these computed trial values by substituting the accelera- 
tions in the right-hand members of (121.4). Thus, taking Af = :J, 

(f .,) = 610.44 _ A [9(_ 24.43) -{- 19(— 23.81) — 5(— 23.20) — 22.61] 

= 616.47, 

(y.,)'*> = 485.56 — ^ [9(_ 51.91) ^ i9(_ 51.10) — 5(— 50.30)— 49.64] 

= 498.44, 
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and eimilatlj for the other ralnea of z and y The correspondisg v’s are 
then computed and then new accelerationa are found from the giren 
differential equations 

It viU be observed that the improved values in the second table (Table B) 
differ very little from the first computed values A second iteration by 
formulas(121 4) makes no improvement whatever eicept m the case of yi/t 
which it changes from 46041 to 460 40 We therefore take the values 
in Table B to be correct 

We are now ready to find y for f = ^ and t = | These are found 
from (121 4) as follows 

yi = 0 + 498 44 + 13(485 56 + 472 88) — 460 40] =: U9 80 ft 

y, _ 0 + i (485 56 + 1891 63 + 460 40) = 236 46 ft 

It will be noted that nearly all these values in Table B are identical 
with those found by the modified Euler method 
Now having three complete lines of the table, we can form first and 
second differences of the quantities x, y, x, jl IlieD w* can continue the 
computation by integrating ahead and back-checking For this purpose 
the following formulas are applied in the order m which they are smtten 

(1) Ay = JJ*” f if = A( [j, + 1 A,y, + ^A,y. + 1 A,y. + |a^. j , 

I 

for finding y in a new line, 

(2) ‘ zii ss AI^i« + |-A,*,-f ^A,i,-f |-A,i,-h|A.x,J, 
for finding x in the new line, 

(3) o=Vx*-fy» , 

(4) y = — 0 OOOOSoy— 32 16, 

(5) x = — OOOOOSpi, 

(6) Ay = ydi = Li [f . — | A.y, — ^ A,y. — ^ A.y.] , 

for checking and correcting the value of y found hy (1) , 

(7) Ax - xdi = Lt Fi. — I A, I, _ ^ AiX, — ^ A,S»J , 

for checking and correcting the value of x found by (2) , . 
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(8) Ay = ‘ ydl = £,t ia,y,_ i A^y. — ^A,y. — ^ A.y,] , 

for finding the new y after the correct valae of y has been obtained In 
these formulas the instant m (1) and (2) is the same as t» m (6), 
(7), and (8) 

The increments in x for the several intervals can be foond by means 
of the formula 

after the correct value of x has been fonnd for the interval considered. 
Since only the range is called for in this problem, however, it is not 
necessary to find x at the end of each inlervii The range is more easily 
found by means of Simpson’s Rule, as follows 

'“X = T + ^ (**+■**+ +^«*) 

+ 2(x» + i*+ +x».|)+^]i 

where 7 denotes the time of flight 

The table is continued with the time interval At sx ^ aec until five 
lines have been computed 

The computed values of Ay and Ax are theu checked by applying 
formulas (108 (108 4), and (108 3 1 to (he acceleration valnes m the 

fifth line, checking the interval (sO to ( = 1/4 by(i08 4), the second 
interval b) (108 5), etc The checks show that all computed values are 
correct 

Since the correct values are given at the first trial for ( = i, ( = and 
( = 1, we start a new table with A( = J sec , using the previously computed 
values of x, y, x, y, and v for the lines ( = 0, < = ( = 1 Here, again, 

the correct values of the several quantities are given at the first trial in 
the fourth and fifth lines of the table So «e double the interval again 
and start a new table with At » 1 sec , using the previously computed 
values for lines t = 0, t = 1, t = 2 This new table is continued up to 
the line t = 8 Then the interval is doubled once more and a new table 
started The computation is continued with this interval until the problem 
IS finished In most cases only one correction is necessary for x, y, and 
V, ind iov § tad * 

When using formulas (1), (2), (6), (7), (8), with At = 2 the student 
should not round off the numbers within the brackets before multiplying 
through by the factor 2 , for by so doing he would double the error due to 
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rounding. He should also be careful not to discard fractional quantities 
of less than half a unit in the second decimal place until he is sure that 
the algebraic sum of these quantities is less than half a unit in the second 
decimal place. Attention to these matters, instead of being a waste of time, 
will frequently save the time and labor of recomputing a whole line in the 
table. For example, let us check the value of Ap in the line for i = 26. 
We have 

Ay = 2 [-376.89 + ^ (47.27) (3.04) (0.15)] 


= — 753.78 + 47.27 — 4- (3.04) — ~ (0.15) 

O ItO 


— — 753.78 + 47.27 — 0.507 — 0.012 = — 707.03. 
By rounding off before multiplying by 2 we have 


Ay = 2[— 376.89 + 23.64 — 0.25 — 0.01] = — 707.02, 

which differs from the previous value by a unit in the last figure. 

The preceding remarks apply with even greater force when At = 4. 

The final results of the computation for this problem are given on the 
following page. 

To find the time of flight we replace the terminal part of the trajectory 
by a parabola through the points corresponding to t = 22, t = 24, and 
i = 26. Hence y is to be a quadratic function of t, and we find this func- 
tion by constructing a table of differences and employing Newton’s inter- 
polation formula (II) of Art. 21. 


i 

i 

y 

1 

AiV j 

Ajy 

22 

1389.97 



24 

780.54 

-609.43 


26 

73.51 

-707.03 

-97.60 


Putting y = 0 in that formula, we have 


.v« 4- A.y„u (u= 4- u) = 0. 

73.51 — 707.03U — 48.8 (u^'-fu.) =0, 




48.8u' 755.83U = 73.51. 


~ 755.83 + 765.26 
97.6 


9.43 

97.6 


= 0.0966, 


or 
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4- Au = 26 + 2 ,X 0.0966 = 26.19 sec. 

We next compute the range by means of Simpson’s Eule. The horizontal 
distance covered during the first two seconds is, taking h — Af -j sec., 

a: = J[610.44 + 4(598.84 + 577.32) + 2 X 587.82 + 567.32] 

= 1176.3 ft. 

For the interval from t = 2 to t = 26, taking A = 2, we have 

X = §[567.32 + 4(531.69 + 476.21 + 434.09 + 399.07 
+ 366.90 + 335.36) + 2(501.77 + 453.93 + 416.00 
+ 382.81 + 351.12) + 319.58] = 10,181 ft. 

Hence the horizontal distance covered in the first 26 seconds is 10181 + H'i'O 
= 11,357 ft. 

To find the distance covered in the remaining 0.19 second we assume that 
the horizontal acceleration will remain at — 7.90 for 0.19 sec. Then the 
change in velocity during this time will be ( — 7.90) X 0.19 = — 1.5. The 
horizontal velocity at the end of 26.19 seconds will therefore be 319.6 — 1.5 
or 318.1 ft./sec., and the average velocity during this fraction of a second 
is (319.6 + 318.1)/2 = 318.8 ft./sec. Hence the horizontal distance covered 
in the last 0,19' sec., is 318.8 X 0.19 = 61 ft. The total range is therefore 


X = 11357 + 61 = 11,418 ft. 


If we compute the increments in x for the several time intervals and add 
them as we go along, as was done in the case of y, we shall find the same 
value for the range as found by Simpson’s Rule. 

If w denote the angle of fall, then 


tan Cl) = 


y. 

ir 


We have already found the value of x for i z=z 26.19. To find y we assume 
that the second difference in y will be the same for the interval i ■=.26 
to t = 26 as for the preceding interval. Then for the next two seconds 
we shall have Ajj? =r 1.64. Hence for one second the change in y will be 
0.82, and for 0.19 second it will be 0.82X0.19 = 0.16. The vertical 
acceleration when t = 26.19 will therefore be —22.85 + 0.16 = —22.69. 
The change in the vertical velocity during the last 0.19 second is then 


— 22.85 — 22.69 

X 0.19 = 


— 4.3. 


2 
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Hence y = — 376 9 — 4 3 = — 381 2 


The terminal Telocity is 

V = V** + y* = V (3181)* +(381 2)* = 496 5 it /eec 
The Talue given by formiil& (119 1) is also 496 5 


EXERCISE XV 

The motion of a bullet is determined by the equations 

^ = — 0 000035p^ 
dr at 

^ — 0 0000351* ^ — 32 16 

If the initial conditions are v 800 ft /sec ^ = CDS 88 it /sec , ^ = 400 
at at 

it /sec when t = 0 dad the horizontal range and time of flight of the 
bullet 
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THE NUMERICAL SOLUTION OF PARTIAL 
DIFFERENTIAL EQUATIONS 

122 . Introduction. One of the greatest needs in applied niatliematics 
is a general and reasonahlv short method of solving ])artial differential 
equations by numerical methods. Several methods have been proposed 
for meeting this need, but none can be called entirely satisfactory. They 
arc all long and laborious. 

Soon after Kunge discovered his method of solving ordinary differential 
equations, Cans ' e.xtendcd the method to partial differential equations 
with given initial conditions. Some 3'ears later, Willers" extended the 
improved Runge-Kutta method to the solution of partial differential equa- 
tions with given initial conditions. These methods are slow and laborious 
and have not come into general use. 

Certain types of boundary-value problems can be solved by replacing the 
differential equation by the corresponding difference equation and then 
solving the latter by a process of iteration. This method of .solving partial 
differential equations was devised and first used by L. F. Richardson.^ It 
was later improved by 11 . Liebmann * and further improved more recently 
by Shortley and Weller.^ The process is slow, but gives good results on 
boundary- value problems which satisfy Laplace’s, Poisson’s, and several 
other partial differential equations. A strong point in it.s favor is that the 
computation can be done by an automatic .sequence-controlled calculating 
machine. 

A somewhat similar method is the relaxation method devised by R. Y. 
Southwell.® This method is shorter and more flexible than the iteration 
method, but is not adapted to automatic machine computation. In both 
of these methods the approximate solution of a partial differential equation, 
with given boundary values, is found by finding the solution of the corre- 
s]!onding partial difference equation. 


' Zcitschri/I ftir Mallicrintik inirf PJtijxik, Vni. 4S (1002). pp. .S04-.’590. 

= yutncrisrhc Intcijrnlina (192.3), pp. 00 )00. 

’ Trans.-ictions of the Roy.il Society A, 210 (1010), pp. .307-.3.'.7. 

‘ Sitmnp^bcrichtc dor in.ith. phy-!. Kl.i-^c <ler Ilaverisrhc Akad Miindien' I'llR 
p. as.*,. ■ * • . 

'.four.not of Applird Pt-vsiM, Vol. 9 n03S), pp. .T?5.,34S. 

* RrlaTation iffthods in Thrordical Physir-;. 
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L DIFFERENCE QUOTIENTS AND DIFFERENCE EQUATIONS 

123 Differeoce Quotients A difference quotient is the quotient ob 
tamed by dividing the difference between two values of a function by the 
difference between the two corresponding values of the independent variable 
Thus for a function /(*) of a single vantble the difference quotient la Uw 

familiar expression — /(£) ^ whose limiting value is the derive 

tive of f(x) with respect to x A difference quotient is thus an approzi 
mation to the derivative the approvimaiion becoming closer as h becomes 
smaller 

Partial difference quotients of the second and higher orders are best 
constructed with reference to a network of points m the xy plane for a 
function o! two variables and in apace for a function of three variables 
For a function w(x y) of two variables, let the xy plane be divided into a 
network or lattice of squares of side k by drawing the two families of 
parallel lines 

x = mh »n = 0 1 , 2 , 

y = nk n = 0, 1 , 2, 


as indicated m Fig 18 The points of intersection of these families of 
lines are called lalUee potnls 

With reference to Fig 18, the forward first difference quotient of u(x, y) 
with respect to x is 

(123 1) + > S) 

h 

and the backward first difference quotient with respect to x is 

(123 2) ?)-«(»-(. yl 

The second difference quotient of «(x,y) with respect to x is the 
difference quotient of the first diffctence quotient*. (125 1) and (123 2) 
Hence we ha\e 

v(* + k y) — «(x,y) _ ii(z y)~u(x — h y) 



u(x + A y) — 2u(x y) + u(g — h y) 
k* 


(123 3) 
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The first- and second-difference quotients of v.{x, y) with respect to y 
are found in exactly the same manner and are 


( 123 . 4 ) 


y + K)— u(x, y) u{x ,y)-~u{x,y--h'l _ 

% = - 1 ’ }i 


and 

ti(x, — 2«(a:, y) + u{x, y — h) 

( 123 . 5 ) • 

Y 

4 













(x,) 

•-f2h) 







(x,v 

+h) 





(x-2 

i,y) (x-i- 

.y) 

y) (x4 

h,y) {x+ 

2h,y) 





(x,y 

-h) 







(x,y 














Fro. 18 


Higher difference quotients are found in exactly the same manner except 
that additional lattice points must be used. 

Difference quotients of a function u{x,y,z) of three variables are formd 
by the same process as ’ised above. Thus for the second-difference quotient 
with respect to z we have 

_ «(=g» y,z + h)~ 2u(x, y, z) -f u(x, v,z — h) 


( 123 . 6 ) 
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The reader will note that the differences used in finding all these 
difference quotients are cenlraJ differences When central differences arc 
used, the inherent error made bj replacing a second derivative by a second 
difference quotient is proportional to h* if & is small Thi« fact can be 
shown by replacing the terms + and u(r — h,y) in (123 3) 

by their Taylor exj ansions and then comparing ur# with 


124. Difference Equations The difference equation corresponding to 
a given differential equation is found by replacing the derivatives by the 
corresponding difference quotients The functions o(x,y) and u{x,y,t) 
occurring in the difference equations are defined only at the lattice points, 
bet we can make these points as close together as desired hr decreasing A 
In order to get simple procedures for solving the difference equations we 
shall assnme that the given differential equation is exactly aatisfied by the 
difference quotients The magnitude of the inherent error resulting from 
this assumption will be investigated later (Art 126) The difference 
equations corresponding to several well known partial differential equations 
are given below 

(a) Laplace s equation /or two dtmennons 




= 0 


Beplacing-s-p and •s-j- b) ti;, and u,„ respectively, we get 


u(z + A y) — 2u(c y) +tt(r — ^ y) 


, u(r y + k)—2u(x y) 4-ufz y — A) 
A* 

from which 


(124 1) u<i,y)=:J[«(* + A,y) + «(ar,y + A) 

+ u(i— A, y) + u(a;, y — A) ] 

This equation shows that the value of « at any interior lattice point is 
the arithmetic mean of the values of u at the four lattice points nearest it 


(b) Laplaces equation for (hree dimensions 


ar* *** 0y* 


Z*Y 

9 ** 


= 0 
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Replacing the second derivatives by the second-difference quotients as given 
by (123.3), (123.5), and (123.'6),and solving for u{x,y,z), we get 

(2) u(x, y,z) — l {v{x + h, y, z) -I- v(x, y -4- li, z) -f u{x, y,z-^}i) 

-4- u{x — h, y, z) -{- u{x.y — a, 2 ) -}- u{x, y,z h)^. 

This equation (2) shows that the value of u at any interior lattice point 
in space is the arithmetic mean of the values of u at the six lattice points 
nearest it. 


(c) 


Poisson’s equation 


in two dimensions, 
dx- dy- 


— i7rp{x,y). 


2 02 J/ 

Replacing and by and respectively, as given by (123.3) 
and (123.5), we get 
(124.2) u{x,y) 

= y)+uix, y+h)-{-u(x—h, y)-f u(a:, y—h)]-\-TTh~p(x, y). 


Here the value of u at an interior lattice point depends not only on the 
u’s of the adjacent points but also e.xpliciily on the value of h and the 
function p{x,y). 

{d) The equation of heat conduction in a plane. 


dT 

dt 


— a- 


dJT,dJT\ 

9yV 


Here t denotes time and T denotes temperature at any time and place, or 
T = T{x,y,t), and a- is a constant. If the temperature of the plane area 

dT 

has reached a steady state, so that^j- = 0, then the above equation reduces 
to Laplace's equation. 

If the steady state has not been reached, the temperature at any point 
depends on the time. Hence the difference quotient at any lattice point 
at time t is 


T, = ~T(x.y. I) 


The second-difference quotients Tj- and at any instant {t fixed) are 
given by (123.3) and (123.5) if « is replaced by T. Hence on replacing 
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the denratiTes in the beat equation by the corresponding diSerence 
quotients, we get 

r(g.y,I + A0 — r(j,y 0 
Li 

T(x + k, y, 0 — tTjt, y, t) + T(x — h y, t) 

A* 

. T(x, y + h, t)—2T(x, y, t) + T(x. y — K,i) 

A* 

from which 
T{x.3,t + Lt) 

= T{x, y, 0 + ^ At[r(* + A, y, t) + T{t, y + a, 0 + r(r- A, y, i) 
+ T(x,y-h,i)~.iT{x.y.t)] 

Since At is an arbitrary increment of time, we may set At = Then 
the above equation reduces to 
(4) r(*,y,l + 40 

= i[r(x + A. y, () + T(x, y + A, 0 + T(x- A, y, t) + r(x, y - A, f)] 

This equation gives the temperatare at any interior lattice point at time 
t + At as the arithmetic mean o( the temperatures of the four adjacent 
laftice points at time t I! the temperature has reached the steady state, 
we have 

(124 3) r(-c,y,t) 

= i lT(x + A, y, 0 + Tix, y + A, 0 + - A, y, f) + T(x, y - A, f)] . 

Other types of partial differential equations esn be replaced by partial 
difference equations by proceeding as in the above examples 

IL TEE UETBOD OP ITERATION 

12S. Solution of Difference Equations by Iteration. We consider a 
process of solving Laplace’s equation m two variables and with given 
boundary conditions For simplicity we assume that the function u(x, y) 
IS required over a rectangular area. We therefore cover the area with a 
network of squares of aide A, as shown in Fig 19 

Since the boundary values of the desired function are assumed to be 
known, we denote them by a’s, as indicated in Fig 19 The values of the 
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required function at the interior lattice points are unknown, but in order 
to start the iteration process by equation (124. 1) we compute rough values 
for them as shown in the solution of Example 1 below. 

We start the iteration process by computing an improved value of u, 
by means of formula (124.1), the new or improved value of u, being 



denoted by u\. Then we proceed to improve U 2 in the same manner, and 
so on with all the other interior lattice points. The traverse, as it is 
called, proceeds over the network in the order in which the points are 
numbered. Thus we have 

vft — -f «2 -j- Oj* 4* ■Ut) 


4- tixs) 

w 8 'i(^ “j~ ^ S 4" ^l*) 


4 - u'sK 4 ~ On), 


^ote that improved values are used as soon as available 
improved values for points ahead. 


in computing 
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The process outlined above is repeated as long as it produces any improve- 
ment in the u’s For the second traseree we would start with 
+ + + 
etc 

Id solving partial diflereoce equations by the iteration process, it is 
adiisable to start with a coarse net (large value of h) Then when itera 
tion gnes no further improvement in the u's, the a hole process is repeated 
with a finer net (smaller value of A) and the iteration carried on until 
no change occurs in the u’s 

Example I Solve the Laplace difference equation for a square region 
and having the boundary values shown m Fig 20 

i^oluhoR e start with a coarse net by dividing the given square into 16 
smaller squares, as shown in the figure 

To get initial values for the interior points of the network, we first find 
a value for u, at the center of the square by taking the mean of the four 
boundary values at the ends of the heavy lines drawn at right angles 
through the center Then we find the values for the centers of the four 
Urge squares into which the given square is divided by the heavy lines 
through the center These values are found by taking the means of the 
values at the ends of the diagonals of the Urge squares * The values for 
the four remaining interior points lying on the heavy central lines are 
found by taking the means of the four adyacent points in each case , that is, 
the four nearest points lying on the horizontal and vertical lines through 
the points considered The computation of some of the interior values is 
shown at the bottom of Fig 20 

Now having all the boundary values for the network and rough values 
for the interior lattice po'nts, we are ready to start with the iteration 
process Beginning with the first interior point in the upper left hand 
corner of the square, wc proceed to the right i-ntil the last interior point 
on the line is improved Then we drop down to the next line and proceed 


* Tbis method of Uking the mevD nf t)c values of the lunction at the ends of 
the die'' nats of a square is perCerllv Ipjritimate because if we make a transforraa 
tion of coordinates b} rotatin;: the t aiJ trex a tl rou;r1i 4o* the ends of the 
diagonals are on the new coordinate a\ev and from the transformation equations 


r- — (.-j/l + /S..E 

B Wilsoia Adrancrii ffllrufur p 112 Fi. ». r Valh-e 1 «u«sm » Toarj (TfnaOsc 
Infimfesimole I (4th Edition) p liS Ex C) ffenee ii satisdes Laplaces equation 
in the Dew coordinates, and Equation (124 1) u therefore valid here 
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from left to right with the interior points in that Ime and so on, the order 
being the same as that followed in reading the lines of a printed page 
The first improved value in the top line of interior points is found 
from formula (184 1) to be 

i/i = i(13 6 + 11 1 + 0 + 6 5) = 7 8 
The improved value for the next lattice point to the right is 
u'* = 3 + 17 0 + 7 8 + 12 5) = 13 65, 

which, for the sake of simplicitj, we round o& to 13 6 

The process is repeated until it produces no change m the values of the 

interior points 

The next step in the computation is to halve the value of A, and repeat 
the iteration process with the smaller aqnarea The initial values for the 
new mesh points are computed just as m the previous case, bj taking the 
the means of the values of the comers to get the values at the centers of 
the previous larger squares and then finding the remaining values b; 
taking the means of the nearest points on the horizontal and vertical lines 
through the point considered Thus, for the value at the center of the £*81 
of the previous squares we hare 

U( — 1(78 + 111 + 0 + 0) s4 7 
For the value at the center of the next old square we hare 
— i(l3 6 + 170 + lll + 78) =124 
Then for ii| of the new mesh points we have 

ti, — J(12 4 + 111 + 47 + 78) =90 

The remaining initial values for the new network are found m like manner 
Having initial values for all the lattice points of the new net, the com- 
puter then begins the iteration process for the new network The first 
improved value for the first interior mesh point in the upper left hand 
comer is (see Fig 21) 

u', = 1(90 + 77 + 0 + 40) =52 

Two applications of the iteration process suffice to complete the solution 
for the new value of h If desired, one could halve h again and get a 
closer approximation for the solutitm of the given example For this new 
computation with a still smaller h, additional intermediate boundary values 
would have to be interpolated, estimated, or scaled from a curve plotted 
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from the given boundary values of Fig. 20. The computed interior points 
will then be no more accurate than the new boundary points. 



Fio. 21 


Remark. The reader should keep in mind the fact that the computed 
values at the mesh points in a network are determined by two things : 

1) . The given differential equation. 

2) . The set of given boundary values. 

Hence if the boundary values are known to only two or three significant 
figures, it is useless to compute the interior points to more figures. 
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Example £ Solve the Laplace difference equation for a square region 
having the boundary equations shown m Jig 24* 
iS^oIutton Here the value of u on the boundaries is given by definite 
analytic expressions which mav be evaluate at any point on the boundary 
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to any desired degree of tocuraey Such boundanes also male it possible 
to express u analytically as a Fonner series and thus enable us to compare 
the numerical solution with the Fourier solution 
We start with a coarse net by dindmg the given square region into 

* Tbe K>VCD boundary valan id tins exsaple sre quantities ot lero dimeaslons, 
or purs numbers Hence tbe computed values at all interior mesb points will like 
wise be pure numbers 
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16 squares. Approximate values of « at the mesh points are found as 
already explained in the preceding example. Five applications of the 
iteration process gave the results shovm in Fig. 22, 

We then halve the value of h and make a new computation, as indicated 
in Fig. 23. The initial values at the nevr interior mesh points are found 
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as explained in the previous example. All initial values are written above 
the corresponding mesh points. The final values for the interior mesh 
points are written below the points. The iteration process was applied 
20 times to get these final values. By noting the time required for one 
traverse, it is an easy matter to estimate the time required for solving 
this problem. • 

Additional values of the function in the region of the network can be 
icuiiu by the foUoTrtcg; procedure r ' 
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Find the values at the centers of the squares by applying formula (124 1) 
to the final values just obtained for the net points Then find the value 
of the function at the midpoints of the sides of the squares by applying 
(124 1) to the new center points and the final values at the mesh points 



The last points to reach tbeii stationary values were those near the 
center of the region, and it may therefore be fairly assumed that the 
values at these points are the least accurate of all, that is, the differences 
between these computed values and the true values of the function are 
greatest for these points On the other band, a Fourier senes for the 
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function gives its most accurate values for these points near the center. 
Hence the difference between the given computed value and the value given 
by a pourier series for points near the center of this region will be very 
close to the true error of the computed values for those points. 

The Fourier series for or for the point x = 2, y -=2, is a rapidly 
converging alternating series whose value is 6.9535 correct to four decimal 
places. The approximate error in the difference equation is thus about 
6.9535 — 6.920, or about 0.03. 

Figure 24 represents the surface u = f{x, y) whose ordinates have been 
computed in this e.xample. 


126. The Inherent Error in the Solution by Difference Equations. 
The inherent error in the difference-equation solution of a differential 
equation can be found b}' e.vpressing the difference quotients in terms of 
derivatives, and this can be done by means of T.aylor’s formula. 

Taylor’s formula for a function of two variables can be written sym- 
bolically in the form 

When k = 0, this becomes 


fix -\-h,y) = f(T, y) 
from which 


di 2 ! 01= ' 3 ! 4 ! dx* 


/(g-f — h d-f , h- 0=/ , d^f , 

h ~3x'^2T0^5-+3T^i-470jr + - • •• 

Changing h io —h in (2), we get 


fi^ a.y) ^ c'f 0=f d^f 

h 3x 2 ! 0x= 3 ! 01= 4 ! ox'' 

Forming the second-difference quotient by subtracting (3) from (2) and 
then dividing throughout by h, we have 


l(? + hn) — 2/(x, y) -f f(x — h, v) d-f . 2h= 

+ terms in h\ I;®, etc. 

Likewise, on putting A=0 in (1) and proceeding e.vactly as above. 


we get 


(5) 


( i^- y ~w k) ■ — 2/(x, y) -f. f(x, y — fc) ^ 2A-= d*f 

~~ TT ^ 

-f terms in k% etc. 
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Putting i = A for a square net, niing the notation of Art 123 for 
second differences, and then adding (4) and (5), we get 


( 6 ) 


- . _ - 3’“ . W>u 2A* ^ 

" 01* 03 ,» 41 dx* + 41 0y‘ 


+ terms in h*, A', etc , 


== ° + (i^ +1^) + *■’ ’ 

since |-r + ^ = 0 by hypothesis The error committed m writing 
ox cjr 

Uf , ujV = 0 IS thus a power aeries m eren powers of A, the principal 
part of the error being the drat term of this series 

Now if we solre the equation ii„ + = 0 and thereby neglect the 

error terms, the error in the solution will be the integral of these error 
terms , and since A is independent of x and y (has a fixed lalue throughout 
the integration), the integral of the error terms will be a power series in 
A*, A*, etc Hence when A is small the principal error in the solution will 
be the first or A* term We are therefore justified in assuming that the 
inherent error in the difference-equation solution of a partial differential 
equation of the second order is proportional to A* 

To find a simple formula for the inherent error, we hare by hypothesis 


E = cA* 


where £ denotes the enor and c is a constant of proportionality Then 
for any two values A, and A} of A, the corresponding errors are Si = cAi* 

and Et ~ cAi*, from which ^ ^ or £, = If =* 

( 7 ) 

Let fli and Oj denote the final approximate values of the function u 
at any interior mesh point, corresponding to A, and A, respectively Then 
« = 0, -1- £, , u = Oj + 

Eliminating ti and taking account of (7), we get 


( 8 ) 


^» = J(«» — «•) 


This formula gives the approximate value of the inherent error at 
each intersection point of the network after two values of A have been 
used, the second value of A being half the first value 

Since u = 0 %, -V Ev> we can snbatilnlK. the vehic at tcoui. and. 

(9) «=:a* + i(o, — B.), 

which gives a close approximation to the true value of u at any net point 
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application of conformal transformation 

As aa application of formulas (8) and (9), let us consider the error 
in « at the point x = 2, y = 2 of Example 2, Art. 125. There Oi = 6.836, 
fl, = 6.920. Hence 

E- = (6.920 — 6.836) = 0.028 
u = 6.920 + 0.028 = 6.948. 

This value agrees closely u'ith the extremely accurate value given by 
Fourier’s series. 

Note. Although the Fourier series solution gives verj' accurate values 
near the center of the region of Example 2, it gives very poor values on 
and near the boundaries even when 12 terms of the series are used. On 
the whole, the solution by difference equations is preferable in that example 
and is obtained by much less work. 

127. Application of Conformal Transformation to Certain Problems. 
In the determination of stresses in thin plates by photo-elastic methods, 
it is sometimes desirable to transform an area bounded by circular arcs 
into a rectangular area wliich can be divided into a network of squares. 
The appropriate transformation is 

te = In 2 , 

where z = x -r iy = r(cos ^ -f- 1 sin S) — re'^ and ta = u -j- iv. On replacing 
w and 2 by their values in terms of «, u, r, 6, we have 

u iv = In re^'^ = In r -f i6. 

Hence, on equating real and imaginary parts, 

( 1 ) u In r, V = 6. 

In order to transform the area bounded by two concentric circles and 
any two radii, denote tlie inner and outer radii by r, and r., respectively, 
and take one boundary as the line ^ = 0 (see Fig. 25). Then from the 
first of equations (1) we have 

Ui = In Tj, = In r^. 

The width of the transformed rectangle is U; — (see Fig. 26); and if 
the rectangular area is to be divided into squares of side h, the’ side of 
one of these squares is 

( 2 ) /i — liLZliiL hi — In Vi 

~~ n ~ n . - 

where n denotes the number of subdivisions of u u, . 
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To find the subdivision points in AB corresponding to those of ? 

we write the equation xh = In r, in the form u = e“', give ii, an increment 
Au, and compute the corresponding increment in r. Thus, 

rj = 

Ti + Ar = 

Ar = = c“' (e*" — 1), 

or 

(3) Ar = r,(e*‘' — 1). 

On putting Au = h,2h,- • ■ (n — l)k we get the subdivision points along 
AB. Note that Ar is measured from the point A on the circle r=:r,. 

To find the subdivisions of the angle from d ~ 0 to 6 = ve consider 
the second of Equations (1), from which 

Av = A6. 


Since the area in Fig. 26 is divided into squares of side h we must have 
Av = h. Hence 


(4) 

where A6 is in radians. 


Ae=:h = 


In r; — In r, 
n 


i 


Having decided on the size of the squares in the transformed area 
A'B'O'D' in Fig. 26, one can compute the corresponding mesh points of 
Fig. 25 by means of Equations (2), (3), and (4). Note that the boun- 
dary ABCD of Fig. 25 is transformed into the boundary A'B'C'I/ of 
Fig. 26, that a point P of Fig. 25 goes into P' of Fig. 26, etc. Note also 
that the transformation gives values of the function closer together on 
the concave side of the given curved area than on the convex .‘^ide — a 
desirable circumstance in stress problems. 

Example. If r, = 2.2, — 3.8, n = 4, find the subdivision intervals 

for r and 0. 

Solution. From (2) we have 

In 3.8 — In 2.2 1.3350 — 0.7885 

^ = 5 = 0.1366. 

Hence A$ = 0.1366 radian = 7° 60'. 

(Ar)i = 2.2 (e® ”''® — 1) =: 0.322 
(Ar), = 2.2 — = 0.691 

(Ar), - 2.2 (€»•*<>*» — 1) = 1.114. 

These Ar’s are to be measured outward from the point where r = 2.2 on 
the line 6 = 0. 
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HI THE METHOD OF RELAXATIOH 

128 Solution of Difference Equations by ReUzatlon In solving the 
Lsplace difference equation by iteration, we employed the relation 

«ti = i («» + «* + “* + “«)» 

or 

«i + «> + «. + «4 — 4 ub = 0 

until the equation was satisfied at any interior lattice point of the network 
Except in the final stages of the process this equation is only approximately 
satisfied, the approximation becoming closer as the iteration process con 
tinues Let denote the residual, or discrepancy, at the lattice point 
so that 

(128 1) Q. = «i + u» + u» + «, — 4u, 

A similar residual equation holds for any other interior lattice point 
To soire the Laplace difference equation by the method of relaxation 
we dmde the region into a network of squares, write down the known 
values of the function at the net pointa on ths boundary, and then compute, 
eetimate, or assign values for the function at all interior net points ]ust 
aa was done m Example 1 of Art 125 Tbe next step is to compute the 
residuals at all interior net points by means of equation (128 1) Tht 
oljeet of t\t rttaxahon proett) to rtduet aU residuals to zero, as nearly 
as possible, by continued alteration ("relaxation") of the values of the 
function at the interior lattice points 
But when the value of tbe function u » changed at a lattice point, the 
values of the residuals at the adjacent interior points must be changed by 
exactly the same amount Furthermore, the residual at the given point 
must be changed by —4 times the change in the function at that point 
These facts will become clear from a consideration of equation (128 1) 
and an appropriate figure 

Let Fig 27 represent a portion of a lattice network Consider the 
point C3 The residual at this point is 
(2) g« = n + A + l + r — 401 

If m IS altered by an amount Am, is necessarily altered by some amount 
Hence 

Oil* + AOu = n + k -f- i -f- ^ — 4(ffi Am) 

Subtracting (2) from this equation, we get 
(128 2) A0, = — 4Am 
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The change in the residual at 03 is thus —4 times the change in the 

function at that point. • t. j 

I/ 3 t us non- see ivhat happens to the residual at C2 when m is changed. 

The residual at 02 is given hy 

(•1) = + g + + 9 

A change in m necessarily changes Qt according to the relation 
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Substracting (4) from this equation, we get 
(128.3) AQj = Am. 

It is thus apparent that when any functional value is altered (relaxed), 
tlie residuals of the adjacent interior points must be changed by an equal 
amount. The relations (128.2) and (128.3) must be strictly observed 
every time a functional value is changed. When the residuals are changed 
as required by (128.2) and (128.3), their resultant values will always 
be the same as those computed by formula (128.1). 

Arithmetical mistakes are e.Tceedingly apt to occur in working a problem 
by the relaxation process, due mainly to the fact that the computer will 
forget to correct some of the residuals at the adjacent points or else will 
make mistakes in combining the new alterations with the previous residuals. 
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Hence <A« comptiter must be extremely careful to maie all rejuired 
eorreclions arising from a given point before he goes on to *Ke next point 
We shall explain the rclazation method further by applying it to th» 
two examples worked m Art 185 
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Example 1 Sohe Example 2 of Art 125 by the method of relaxation 

Solution We take from Fig 22 the boundary values and the approii 
mate values of the function at the interior lattice points, as shown m 
Fig 28 Then we compute the residuals for all interior points by formula 
(128 1) The relaxation process may be started at any point, but it lo 
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advisable and customary to begin near the center of the lattice area and 
at the point having the largest residual. Then proceed to the point having 
the next largest residual, and so on. Furthermore, in order to “ liquidate ” 
a residual at any point, the increment of the function at that point must 
have the same algebraic sign as the residual and must be one-fourth as 
large. Hence to find the required magnitude of the relaxation at any 
point we divide the residual at that point by 4. 

The largest residual in Fig. 28 is at the point C3. Hence we relax u 

at that point by the amount = 0.274. Then according to equations 

(128.2) and (128.3) we must add — 4X 0.274 to.the residual at 03 
and add 0.274 to the residuals at the four adjacent lattice points as 
indicated in the figure, the results of these additions being recorded as the 
new residuals at the affected points. 

The next largest residuals are at B2 and B4. Hence we relax at these 
points by the amount — 0.164 and correct all affected residuals according 
to equations (128.2) and (128.3). Note that we record the new value 
of the function at the relaxed point as soon as the relaxation is made. 

The greatest remaining residuals are at D2 and 1)4. So we relax at 
these points by — 0.110. Then we relax at B3‘by the amount — 0.014 and 
at D3 by 0.014. BZ and D4 are next relaxed by 0.004, and then 152 and 
Bi are relaxed by — 0,003. Then relax D3 by 0,002 and B3 by — 0.001. 
Now relax B2 and Bi by — 0.001, Finally, relax i?3 by 0.001. No further 
improvement is possible without decreasing the size of the mesh squares. 
It will be noted that the final residuals satisfy equation (128. 1), and that 
the final values of the function at the interior mesh points are the same 
(with one exception) as those found by the iteration process in Fig. 22. 
No computation by the relaxation method is finished until the final residuals 
are checked by (128.1) and found to satisfy that equation. ' 

The reader who is studying the relaxation method for the first time 
should work the above problem for himself by carrying out the compu- 
tation as outlined above. 

Example 2. Continue the solution of the above example by the relaxa- 
tion process when the value of h is halved. 

Soluiion. We take from Fig. 23 the values of the function « on the 
boundaries and at all interior mesh points, and enter them in Fig. 29 as 
shown. Then we compute by formula (128. 1), the residuals at the interior 
points. The relaxation is started at B2 and B8 by relaxing at these points 
by —0.041. The mesh-point values having the next largest residuals are 
then relaxed and the process continued until no residual exceeds 0.002 in 
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magnitude It is not possible to reduce Ail residuals to a smaller magnitude 
The final values of the function at the interior mesh points, and their 
corieoponding residuals, are recorded below the dotted lines in Fig 29, the 
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corresponding initial values being written above the horizontal lines through 
the mesh points It will be seen that the final values agree within a unit 
in the last digit with the valuea found bj iteration m Fig 33 
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The trend of the functional values in lines D to E enabled us to speed 
UP the convergence of the relaxation process to some extent, as it soon 
bLme evident that these functional values were continually 
Hence it was safe to overrelai in this area; that is, instead of changing 
fhe functional values by amounts just sufficient to 

we change the functional values enough to produce residuals with changed 
signs and as large as they were before. The new residuals ^ 

wLd out by increments added when adjacent points are relaxed. Such 
over-relaxation is always advisable when the residuals adjacent to a given 
point have the same sign as the residual at that point. 

In carrying out the computation for this problem some of the functional 
values had to be relaxed 14 times, by amounts varying from O OW at first 
down to 0.001 at the end. The number of relaxations could l^ave been 
decreased by drastic overrelaxation in the central region of the network. 
But drastic overrelaxation should not be resorted to unless the computer 
knows about what the functional values should be in the end. 

129. Triangular Networks. Although the square network is the sim- 
plest and the one most commonly used, a network of equilateral triangles 
is sometimes more suitable for a particular problem. This is likely to be 
the case in a region having an irregular or angular boundary. Fig. 30 
represents a portion of a triangular network. 






In this case the fundamental relation which must be satisfied in the case 
of Laplace’s equation is 

(1) Uo = i(Ui Uj -1- Us til -}- -Uj Ue), 

and the residuals are given by 

(2) — Ui -f- -i- Wj + «4 + «5 -f Vo — 6Uo. 
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FormuJa (1) is derived on pages 2123 of Southwell’s booh mentioned 
above Incidentall), Southwell points out, p 24, that formula (1) is more 
accurate than (124 1) 

Formulas (1) and (2) are applied to triangular networks in exactly 
the same manner aa (124 1) and (128 1) are applied to networks of 
square meshes Formula (128 3) applies unchanged to triangular net- 
works, but (128 2) must be replaced b} 

(3) A0,= — 6Am 

Hence to liquidate a residual at any point, we must relax by one-sixth the 
residual at that point and then add the increment to the residuals at the 
SIX adjacent points 

130 Block Relaxation Up to this point we ham been altering or 
relaxing one functional value at a time It sometimes saves time and labor 
to relax a whole group of functional values at a time This procedure 
IS advisable when the residuals at adjacent points in a region are nearly 
equal In this case the functional values are relaxed aa a block by changing 
them all by the same amount We now consider the effect of snch block 
relaxation on the residuals within the block and on those outside it 

In Fig 31 the group in the region surrounded by the heavy border are 
to be relaxed as a block by relaxing all functional values in the block 
(including those on the border) by ao amount v It is clearly evident 
that the residuals at interior points such as P are not altered by block 
relaxation, for although the residual at such a point is immediately 
changed by — 4<, each of the four adjacent points o, b, c, d contributes a 
quantity < to this residual and. thus leaves it unchanged by the block 
relaxation 

Such IS not the case at points on the border The residual at each of 
these is immediately changed bj — 4<, but the compensating contributions 
from adjacent points depend on how many of the adjacent points are in 
the relaxed block The residual at point M, for example, is not changed, 
because the four adjacent points are all in the relaxed block The same is 
true at Q and S At the point N three of the adjacent points are m the 
block and one outside it , so the residual at N is changed by — t At B, 
two of the adjacent points are in the block and two outside it Hence at 
R the residual is changed by — 2* 

The amount of change in the residual at anj border point on a square 
network is evidently — fw, where n denotes the number of adjacent points 
which lie outside the relaxed block 



BLOCK RELAXATION 


411 


Aut. 130] 


Similar considerations apply to a triangular network. At all interior 
points such as P in Fig. 32 the residuals are not changed, whereas at all 
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Rcsiduftls at Border Points Changed by — nt, where 
n = Number of Adjacent Points Outside the Relaxed Block. 
Fiq. 31 


border points the residuals are changed by the amount — n<, where n 
denotes the number of adjacent points lying outside the relaxed area. 
At B, for example, the residual is changed by — t, whereas at A the 
change is — 4c. 

"When the functional values in a block are relaxed by an amount e, the 
residuals of all adjacent points just outside the block must also be changed 
by an amount c as required by formula (128.3). 
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In bloclc relaiation all functional Tallies in the block are charged bj 
the aame amount, but no residuals are changed except those at the points 
on the border This procedure nay thereby sate much time, and it also 
reduces the possibility of inthmetieal errors. 



Rnidasli »t Border PoinU Changed by ■— n< nbere 
fl = dumber of Adjacent Poiota P«(«ide the Relaxed Block 

Pm as 

The amount by which all foBctiond xalues la a block are relaxed may 
be anything desired. Southwell relaxes a block of Talues in accordance 
with the formula 

m 

where SQ denotes the algeiraic sum ^the residqtli in the block and m 
denotes the number of #i;acrnl poinfs7«t the bheh (The outside 
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adjacent points should be thought of as outside connections to the block 
points. Sometimes an outside point is connected to two block points and 
is then to be counted as two adjacent points outside the block. See Pig. 33.) 

Example. Let it be required to relax as a block the functional values 
within the bordered area of Pig. 33, only the residuals being shown. 
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Hero 

end 


= 31 -j- 27 + 18 -I = 581 


n = 22 
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Usinj round numbers, we rilnx all functional values of the block by 26 
and change the border residuals b) — 26«, the results being indicated in 
Fig 33 Note that the residuals of the outside points adjacent to the 
border liaie been cliangod as required bj formula (128 3) 

One iinj a!'C lelax a block within a larger block that is to be relaxed 
In that ca-c the inner block should be relaxed first and the residuals at 
outside points a(ljar«.nt to its border changed in accordance with formula 
(128 3) Ihcii the larger block (including the relaxed inner one) can 
he relaxed as desired 

After a group of values has been relaxed as a block, the whole network 
(both in«idc and oiitaidc the block) may bo relaxed point by point in anv 
manner until all rcciduaU base been liquidated 

131 The Iteration and Relaxation Methods Compared The method 
of iteration and the method of relaxation are both tneihoda for solving 
partial diflirence equations with gnen boundary salnes Although they 
reach (he desired solution by different processes, both methods are of the 
same inherent accuraev Their points of similarity and dissimilsnty are 
listnd beliw 

1 Roth mithods require that the bounded region be divided into a set 
work of squares or other similar polygons 

2 Both methods require that the boundary values be written down and 
that rough values of the (unction be computed, estimated, or assumed for 
all interior points of the network 

3 In order to start a computation, the iteration method assumes that 
a functional value at any mesh point satifies the given difference equation 
(Laplace’s Foi8son’«, etc ) and thereby derives the relation which must 
exist between that functional value and the adjacent functional values 
The process of iteration is then applied until (he required relation is 
satisfied 

4 The method of relaxation, on the other hand, recognizes at the start 
that an assumed functional valnc at any mesh point will not satisfy the 
given difference equation, but that there will be a rtsidudl at that point 
The residuals are computed for all points before the relaxations process 
is started 

5 The method of iteration starts with the upper left hand corner of the 
network and proceeds to correct all net-work values by means of fomnia 
(124 1) (in the case of Laplace’s equation), using the latest computed 
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values available. The process is carried out in a systematic and definite 
order by going from left to right until the end of a line is reached and 
then dropping down to the next line, just as in reading the consecutive 
lines of a printed page. This method of correcting the netpoint values 
is continued until no further improvements can be effected by the iteration 
process. Tlie iteration process can be performed mechanically by an auto- 
matic sequence-controlled calculating machine. 

6. The method of relaxation requires that the residuals at every interior 
netpoint be computed by formula (128.1). Then these residuals are 
liquidated or reduced to zero (or nearly so) as qriickly as possible by 
altering (relaxing) the netpoint values to any extent that seems advisable, 
always observing that the increment of the function must be of the same 
sign as the residual at that point and being careful to correct all affected 
residuals in accordance with formulas (128.2) and (128.3). The revised 
values of the function should also be recorded at the time of alteration. 
The relaxation process may start at any interior netpoint and jump around 
all over the bounded region, usually beginning with the numerically largest 
residuals and then proceeding to the next largest wherever they may be 
found. Because of the perfectly arbitrary manner in which the relaxations 
are made, the rela.\ation process cannot be carried out by an automatic 
calculating machine. It is an individual, hand method just as the slide 
rule is a hand device. 

7. The iteration process is slow, sure, and frequently long. The relaxa- 
tion process is more rapid, less certain, and usually reasonably short. The 
convergence is rapid by both methods at first, but becomes slow with both 
methods long before the end is reached. 

8. The arithmetic operations are easier and shorter with the method of 
relaxation. The mental effort necessary' to avoid mistakes, however, is 
much greater than with the iteration method. 

9. The greatest drawback to the method of iteration is its length; the 
greatest drawback to the method of relaxation is its liability to errors of 
computation. Such errors can be kept out only by extreme care and 
unceasing vigilance on the part of the computer. 

10. Computational errors in the method of iteration are immediately 
evident and are self-correcting. In the method of rela.xation any errors 
in the functional values remain hidden and can be brought to light only 
by application of formula (128.1). For this reason, all interior netpoint 
values should be checked by (128.1) several times during a long compu- 
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taiion Such checking takes time and keeps the relaxation process from 
being as short as it might at first appear 

11 In the iteration process, attention is always fixed on the functional 
values at the lattice points, in the relaxation process attention is always 
centered on the residuals at those points 
When a computer discovers that a mistake has occurred somewhere in 
the relaxation solution, he should not spend much time in looking for its 
origin Instead, he should compute all residuals by formula (128 1) and 
continue the solution with the new residuals 
The reader should solve a problem of moderate length by both iteration 
and relaxation Then he can decide for himself which method is pre 
ferable in his case 

Further information concerning short cuts, etc in the iteration method 
can be found m the papers by Shorlley anil Weller, and additional informa 
tion concerning the method of relaxation can be fonnd m a valuable paper 
by Howard W Emmons, entitled “The Numerical Solution of Partial 
Differential Equations ” {QmrUrlt/ cf AppUed italhemalta,Yo\ II, No 3, 
pp 173 195 Oct 1944), and mR V Southwell s JlfelAoifj tn 
Theoretical Physics 1946 

IT THE SAYLEIGH SITZ HETSOD 

132 Introduction The Rayleigh Ritz method of solving boundary 
value problems is entirely different from either of the two methods con 
iideied in the preceding pages It is not based on difference equations 
and does not employ them In finding the solution of a physical problem 
by this method, one assumes that the solution can be represented by a 
linear combination of simple and easily calculated functions each of which 
satisfies the given boundary conditions After the problem has been 
formulated as the definite integral of the algebraic sum of two or more 
homogeneous, positive, and definite quadratic forms, or as the quotient of 
two such integrals, the desired unknown function is replaced in the 
integrals by the assumed linear combination Then the integral or the 
quotient of the integrals, is minimized with respect to each of the arbitraiy 
constants occurring in the linear combination 
This method is direct and short if only approximate results are desired, 
but if results of high accuracy are required, the method is quite labonous 
end the labor cannot be appreciably lessened by mechanical aids The 
labor involved is mostly in long and tedious algebraic manipulations 
A special and simple form of the Rayleigh Ritz method was first used 
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by Lord Rayleigh » (J. W. Strutt) for finding the fundamental vibration 
period of an clastic body. It was later extended, generalized, and its con- 
vergence proved by W. Ritz.' We shall attempt to explain it to some 
extent by applying it to two examples. 

133. The Vibrating String. Consider a tightly stretched elastic string 
or wire of length 2 and fixed at the ends, and assume that it vibrates in a 
vacuum. Ijct P denote the tension in the string and let p denote the 
mass of unit length of the string. With coordinate axes as shown in 
Fig. 34, let y denote the displacement of any point along the i-axis. 

Y 



pAi. 

y 

Fia. 34 



Then y is evidently a function of both the distance x and the time t. The 
differential equation for the motion of a point of the string is thus a 
partial differential equation and is easily shown to be * 


(1) ^ ^ with the boundary conditions y(0) = 0, y{l) — 0. 

If we also impose the initial condition that ^ = 0 when f = 0, we find 


by the method of separation of variables that the solution of (1) is 

(2; y = Csm~xcQS^J~ n = 1, 2, 3, • • • . 

‘ p I 

The vibration frequency is therefore 


(3) 




* Theory of Sound, S8, 89. 

' Journal fur die reine ur.d cngctcandte Mathematih, Bd. CXXXV, pp. 1-Gl • 
Ootimg^ Xcekrichtcn, math.-physik. Klasse, 1903, pp. 23G-248; Annalcn icr Physik, 

iul po Gesammelte Werke Waithe; 

ParnVT diflerentml equations; for example, Miller’s 

i-orJuiI DiffcrenUal EquaUons, pp. C9-70. 
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For n = 1 we get the natural or fundamental frequency Hence for this 
frequency we have 



Th» higher frequencies or oTertonea are found from (3) by putting 
n =: 2, 3, etc 

To find the vibration frequencies of the cord by the Ravleigh Ritz method, 
re neither set up a partial differcntiat equation nor solve one On the 
contrary, we assume that the cord is vibrating in a vacuum and utilize 
the fact that under this condition the total energy of the vibrating cord 
remains constant Hence the maiimum kinetic energy must be equal to 
the maximum potential energy 

The potential energy at any instant is the stored up elastic energy due 
to stretching It is equal to the work done in stretching the string to its 
longer form in the bowed position Since the total energy of the string 
IS constant, the potential energy at the end of a awing when the string 
com«.8 momentarily to rest w equal to the kinetic energy when the string 
coincides with the x axis and la at that instant unstretched 
Because of the elasticity of the material of the string the deflection y 
at any point is, by Hooke’s law, proportional to the force m the y direction 
Hence the motion is necessarily harmonic and can be represented by the 
equation 

(5) y~.^sm«i>(, 

where ^ is a function of x alone and « is a constant 
From Fig 34 it is evident that the increase in length of an initially 
unstretched segment dx is ds — dx, or 

+ (sy = (V ' + (s)’-0 

and the work done in producing this stretch is I "f* 

Hence the work done in stretching the whole string is 

On expanding the radical into a binomial senes and neglecting ■ 
m' , etc , since the slope of the string la amall, we have 
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_F f' 

2 Jo \dxj 

Now replacing I’nlue found from (5), Ye have 

This is the potential energj’ of the string at any time. Its maximum value 
is when sin <ut ~ 1. Hence 

u:m-- 


Un 


fdyY 

The kinetic energj' of a segment dx of the vibrating string is ipdx I ^ j 
and therefore for the whole string it is 

8v 

Jleplacing ~ by its value from (5), we have 


T = cos® b>i. 

This has its maximum value when cos* iat — 1. Hence the maximum 
kinetic energy is 

= X'-dx. 

Since Vmtx ~ Tan , get 



The next step in solving this problem by the Eitz method is to choose 
for X a simple function which satisfies the boundary conditions and 
contains several parameters. These parameters are to be chosen or deter- 
mined so as to make the right member of (6) a minimum. A suitable 
expression for X in the vibrating string problem is 

(7) Z = x{l — s) (oi 4- 0 - 1 -{- 0 , 1 ® -f- • • 
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This IS substituted for i la {6> and then the partial denvatiTe of the 
Tight member with respect to each parameter is placed equal to lero 
The result is a sj’tem of homogeneous linear equations in the unlcnowu 
parameters 

In order to reduce the labor of finding the partial deriratives of the 
right member of (C) ue differentiate it with respect to a typical parameter 
and derive a formula from which the linear equations are easily obtained 
Bearing m mind that A, aa expressed by (7), contains the independent 
parameters p,aj a, ue hare by (6) and by using the rule for 
differentiating a quotient, 

^/p S: 

But, by (6) Making this substitution in 

the second term of the equation above, we get 


Taking out the common factor ^ X*dx, which is not zero we hare 
or 

where h = ^ 


In order to increase the rapidity of conrergence of the Eitz process, 
we shall move the origin of space coordinates to the midpoint of the 
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string. Then the boundary conditions will he y{ — 7/2) ■=y{J/Z) =0, 
and the appropriate polynomial to meet these conditions will be 

(9) X = (c* — a;*) (ci -}- fl?®* Aj®* + ' ’ ')} 

where c = 7/2. It is to be noted that (9) gives only the modes of vibration, 
which are symmetric to the position of the y-axis. 

Taking only the first term of (9) as a first approximation for X, we have 

A' = a.(c=-x»), ^ = 

Then 



X'dx = a, ■ J" {c* — 2c^x=-\-x*)dx = ^ai‘c\ 
Substituting these in (8), we get 


_d 

da 


:( T - 4 -’)= 


IGciC’ Z2haiC^ 

~3 15 


= 0 . 


10 


Hence Ar = ~ , The exact value of h as previously found is 

7; = -^ = - The agreement is thus fairly close. 

To get a better approximation, we take the first two terms of (9), 
Then 

X = {o' — i") (ci -f fls®^) > 

and 

Hence 


dx 


— — 2oii + ZaiC'x — 40-2:’. 


and 


J.c\ dx) 3 ^16 


go 


16 


Substituting these in (8), taking the partial derivatives with respect to 
Cl end C; m turn, and then reducing slightly, we get 

,, 2A-C- . c* 27 - 0 = 

r“)«» -fy (1 ^)ff2 = 0. 


5 

2A:c- 


)a, +y (11 


2)tc* 


)C2 = 0. 


(1 


7 



bOILTIONCd 1 mriAL DIFFERENTUL EQUATIONS {Ciuf XIV 


These two homogeneous equations wiU hare a common non trmal sola 
tion only if the determinant of their coefificienta is zero, or 

2tc’ c* . 2ke* 

^5 6 ' r 

^7 T ' 3 

from which we get 

c'l* — 28c*t + 63 = 0 
Solving this equation for Ji, we find 

, 25 53258 2 46744 


In the exact case we found 


pit* t. _ nV 

T"**” I* "* 4e* 

Hence 

. . , W* 9 869604 2467401 

forn = l, l, = _=_j^=— 

lo,n = 3 t = = 

4tf* C* 

On comparing the shore Ritz values of k with these exact values, we see 
that for the fundamental mode the Bitz value agrees with the exact value 
to five significant figures 

Values of still greater accuracy can be found by taking the first three 
terms of the second parenthesis of (9) 


X— (c* — a:*)((i, 4 -o,z*-l-ajZ‘) 

On evaluating s:m- X*dx differentiating them with 

respect to O], a,, a, in turn and substituting the results in (8), we get 


l/i . c*/, 2i:c»\ , c*/, 

IV — 6"j‘'‘+i5V-“rr'+^V-— 

1^1 Skcn 2fcc*\ , Jl 2kc‘\ 

86V 9 ) ‘*^3^ 831/ **^33X7 So)"’”® 
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These homogeneous equations will have a common, non-trivial solution if 
and only if 



1/ Zhc^\ c'(l 2kc^\ c* f 13 2fcc^\ 
35 V 9 j 3 Vs 231/ 33 V 7 39/ 


Putting 2tc* = A, expanding the determinant, and simplifying, we get 
A* — 225A'' + 8910A — 38610 = 0, 

where all the coefficients are exact numbers (not rounded). 

The smallest root of the above cubic equation is easily found by the 
Newton-Eapbson method, starting with the approximate value 4.93488 
(or preferably 4.935) found in the previous calculation. The new value 
is thus found to be 

Aj = 4.934802217, 
correct to the last digit given. 

The other two roots are best found by taking the root Ai out of the given 
equation, by 63 rnthetic division, and then solving the resulting quadratic 
equation. The depressed equation is 

A" — 220.066197783A + 7824.02177410 = 0, 

the roots of which (found by the quadratic formula) are 

A. = 44.586811825, A, = 176.478386958. 

As a check on these values it may be noted that 

Ai f Aj + Aj = 225.000,000,000, 

as required by theory. 

Wc will now compare these Ritz values with the exact values. Since 


A = k 



and 


P P 

p i* ~ p 4c* ’ 


A = 


nV 

2 • 


we find 
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Hence 

, = 4 934802200545. 

A, — 2 — 2 

X,=^ = 44 4132198, 

A,=r^-123 37 

It will be noted that the Rit? valae for A, is correct to eight significant 
figures that the value for Ap is hardly correct to two figures, and that Ifie 
value of At, although of the proper order of magnitude, is so inaccurate 
as to be almost worthless 

Ihe reader will observe that all the Rita values are larger than the 
corrc°paDdiDg exact values This is usually the case The reader should 
also note that more accurate Ritz values were found by taking additional 
terms to (9) and not by correcting previous values As more terms of (9) 
are taken the labor of computation increases enormously, so that more then 
three terms will involve an almost prohibitive amount of labor 

134 Vibration of a Rectangular Membrane Consider a tbin elastic 
membrane of rectangular form vntb aides o and h (Fig 35), such as a 
very thin sheet of rubber, and 
Z assume that the membrane u 

made fast at the edges while 
tightly stretched. Take a set 
of three mutually perpendicn 
lar axes, with the zy plane 
coinciding with the membrane 
and the s axis perpendicular to 
it Then if an interior region 
of the membrane be palled or 
pushed lu a direction at right 
angles to its plane of equt 
librium (the ly plane), it be 
Y comes distorted into a curved 

Fla 35 surface, the area of which is 
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approximately, since the distortion is small. The increase in area of the 
roemhratie due to the distortion, is therefore 

‘-/.'/.■[‘ti©’**®)'!"*"' 

-j;r[©Al)']‘«* 

Let T denote the tension on a unit length of boundary of the membrane, 
the direction of T being perpendicular to the edge of the boundary. Then 
the wort done in deflecting the membrane mitil its area is increased by 
an amount AS is TAS; *' and the potential energy in the deflected positjon 
is equal to the wort done in producing the deflection. Since the deflection 
is small, the tension T remains practically constant. Hence the potential 
energy of the membrane in a deflected position is 


P.E. = 




Because of the elasticity of the membrane, the deflection at any point is 
proportional to the force applied, and the motion is thus simple harmonic. 
Hence the deflection is a periodic function of the time, or 


s~Z{x,y) sin wt. 


AT(u+fiu) 


A 


V 


TZZZZZZZZZZZZZZ^ 


* Consider a rectangular region of dimensions « and v (Fig. 36). First let the 
side A-B be fixed and let the membrane be pulled to the right with a force of T 

pounds per unit of width, or Tv for 
the whole side. The force Tv will 
stretch the membrane an amount 
Au and do Tv • Av units of work in 
doing 80 . 

Now let the side BO he fixed and 
let the membrane be pulled in the 
direction of the side AB by a force 
of T pounds per unit length of 
border, or T (« -}- du) for tho whole 
aide. The force Tfu + At;) will 
stretch the membrane by an amount 
Ac in that direction and do 
Tfu + Aij) - At? units of work in 
doing BO. 


u 


z 


au 


Pin. 36 

Ecnrc the tot.sl work done is 


Tt' • Au + T(u + da) - Au = YffAu -{* uAr -p AuAo) 
= T times area of shaded border 
= T times increase in area of membrane. 
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On substituting this value of z in the above expression for the potential 
energy, we get 

The roaximum value of this is 

The kinetic energy of an element dm =:pdt/dx of the membrane is 
ipdt/dx • =i/>di/dx Z*(i:,y)w*cos*u(, 

where p denotes the mass of unit area of the membrane 
The kinetic energy of the entire vibrating membrane is therefore 

K E = (Kp//// Z*dy dx) cos**»t, 
and the maximum value of this is 


(KE). 




Since there is usumed to be no loss of energy due to vibration, the mas* 
mum potential energy is equal to the maximum kinetic energy and we 
thus have 


or 

0) 


. 77'[(gy^(iy]->-- 

' X7>''>'* 


We must now assume for Z a linear combinanon of simple functions 
which will satisfy the boundary conditions of the problem Such a func- 
tion u 


(2) Z = (a — !)(& — y)(oi -f a.z + o,y + o«z* + «,y* -f aay + • •)• 

In order to make the convergence aa rapid as possible, however, we move 
the cngin to the center of the rectangle Then because of symmetry we 
may write 
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(3) z = (p- — 2 :”) (g* — y~) (oi + + ' ' ■)> 

where p = a/^, q — 6/2. 

As-suming that Z in (1) has been replaced by (2) or (3) above, we 
must determine the a’s so as to make to" a minimum. Hence the derivative 
of the right member of (1) with respect to each of the o’s must be zero. 
Then by the rule for differentiating a quotient we have 

x” ■ w(rx.* 1 (i) +(1) } 

-x;x:i(ir+(ri^^-i/:x>^*=“- 

Eeplacing 

r/.’Ka'tffiyi'-'- 

in the second term by its value 

% 

as found from (1), we have 

x:/:-^-^/;x;)(fr+(iy}^^- 

- '^r * * ■ kS’ />■ = O' . 

X o p}} 

I Z-dy dxj we get 

HT iciy+(iy 

or 

ItC/o So 1@) +(f) [ 

whore 1: ~ poi-/T and 1 = 1, 2, • • • jj. Formula (4) will give n homo- 
geneous equations for determining n values of fc. 

If the form (3) is used for Z, the limits of integration in (4) will be 
from — p to p for 2 ; and — g to q for y. 

To get a first approximation to the vibration frequency of the membrane, 
we take only the first term of the parenthetic polynomial in (3). Then 
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dz 


z = a,(p*— y*) 

— s=~2a,i(g*— jf*> 

= — 2a,y(p*— I*). 


~ wj’' {i’(g*— y’)* + y*(p’--*’)*}<^y(^* 

= ■‘“■’/’.(if = |(n) ?■«■<?■ + 

&nd 

J"' J** Z* rfy dz = a^’ J*' (p* — i*)*(g* — y*)* iy dr =: pYa,*. 

On substituting th«se in (4), we get 

^ 1 1 (t!) + «■' - ‘■(it)’ \ = "■ 

or 

f (p' + j’)-||ipV = o. 

from which 

2 \ pY / 2Vp*^?V 

Replacing p by a/2 and q by 6/2, we get 

Since k = p<a'/T, we finally get 


The frequency is therefore 


’ Zw 2*^p\o*^6V 


This IS the lowest or natural Tibration frequency of the membrane 

The vibration frequencies found by the classical method of separating 
the variables are given by the fonnula p 
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For m = 1, n = 1, this formula becomes 



Since V 10/2®- = 0.5033, it is evident that the Ritz method gives a close 
approximation to the exact value. A more accurate value could be obtained 
by taking the first three terms of the parenthetical polynomial in (3), but 
the increased accuracy would be obtained at considerable expense in time 
and labor. 

136. Comments on the Three Methods. Three numerical methods for 
solving boundary-value problems in two dimensions have been considered 
in the present chapter. Each method has its advantages and disadvantages. 
The iteration method is slow, self-correcting, and well adapted to use with 
an automatic sequence-controlled calculating machine. The arithmetical 
operations are short and simple. 

The relaxation method is faster and more flexible than the iteration 
method. The arithmetical operations are simple, but mistakes are easy to 
make and are not self-correcting. It requires constant vigilance and alert- 
ness on the part of the computer. It is not adapted to use by an automatic 
calculating machine. 

The Rayleigh-Ritz method is of considerable value in handling problems 
of equilibrium and elastic vibrations. It does not require a partial dif- 
ferential equation to start with, but it does require that a physical problem 
be reduced to the definite integral of a sum, difference, or quotient of two 
or more homogeneous positive and definite quadratic forms. The method 
furnishes a short and easy way of finding a good approximation to the 
natural vibration period of an elastic body, deflection of a membrane, etc. 
The chief disadvantage of the method is the laborious algebra involved in 
getting results of high accuracy. 

It is an easy matter to estimate the accuracy of results obtained by tbe 
iteration and relaxation methods, but this is not the case with the Raleigh- 
Ritz method. No simple and useful formula for estimating the inherent 
error involved in this method has yet been devised. 

A choice between the iteration and relaxation methods would depend 
upon the mechanical aids at the disposal of the computer. If an automatic 
sequence-controlled calculator is at hand, the iteration method would be 
used. If an automatic calculator is not at hand, the relaxation will give 
the desired solution in the shortest time and with the least work. 
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Finally, it most be realized that not all three methods may be applicable 
to a given problem To use the iteration and relaxation methods a physical 
problem must first be set up as a partial differential equation and this must 
then be converted to a partial difference equation The Hayleigh Ritz 
method vill give an approximate solution of a problem without setting up 
a partial differential equation, as was done in the cases of the vibrating 
string and vibrating membrane In problems where all three methods are 
applicable, the Bajleigh Bits method would probably be the third choice 

It IS needless to say that all these methods are inferior to the classical 
method of separating the variables, but they will give approximate solo 
tious to problems in which the variables cannot be separated. 
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CHAPTER XV 

THE NUMERICAL SOLUTION OF INTEGRAL EQUATIONS 

136. Integral Equations — Definitions. An integral equation is a func- 
tional equation in -which the unknown function occurs under the integral 
sign as -well as outside it. The simplest type imaginable arises from the 
integration of the simple differential equation dy/ds — f{x,y), -with the 
initial condition y — Ho when x = Xa, The result is 

y= f f{x,y)dx-\-C= f f{x,y)dx-\-yo, 

Xa 

as stated on page 315. Two important types of integral equations are 

( 1 ) 

and 

(2) 4 >{x)=f{x) + jy{x,t)^{,t)dt. 

Here the functions E{x, t) and f{x) are kno-wn and ^(z) is the unknown. 
K{x,t) is called the kernel or nucleus and is assumed to be a continuous 
function of x and t throughout the interval {a,b); that is, a'^x^b, 
a'^i'^b. In physical problems the kernel is usually Green’s function. 

Equations (1) and (2) are called linear integral equations because the 
unknown function c|) occurs to the first degree. Also, (1) is called a homo- 
geneous equation and (2) is called a non-homogeneous equation. 

An integral equation of the form 

(3) 4,(x)=f{x)+ f Z{z,t)F[i,<^(0]de 

nJ c 

is called a non-linear integral equation because the unknown function <f> 
docs not occur in a linear fashion. 

To solve an integral equation of any type is to find the unknown func- 
tion ^(i). In some cases this can be done by the method of iteration, 
by starting with an approximate value for 4>{x), substituting it in the 
integrand, and performing the integration. The new value of 4>{x) is then 
substituted in the integrand as before and the process is repeated -until 
no improvement is found in i^{x). In general, however, the solution of 
integral equations by exact analjdical methods is not easy. Hence it is 
necessary to fall back on approximate solutions by numerical methods. 
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Several methods have been proposed for finding numerical solutions of 
integral equations One of the simplest and most direct is the method 
suggested by Goursat • and later developed and extended in various direc 
tions by Nystrom • The method explained in the following pages is a 
modification and amplification of Nystrom a method The method consists 
essentially m replacing the unknown function under the integral sign by 
a polynomial of some form integrating this polynomial over an interval, 
and then evaluating the integral at certain specified points within the 
interval of integration 

Before proceeding to the numerical solution of integral equations, we 
make a short digression to indicate Jiow integral equations can arise from 
simple problems and particularly how the kernel gets into the equation 

137 Boundary Value Problems of Ordinary Differential Equations. 
Green’s Functions In the elementary treatment of differential equations 
the function and all its derivatives are assumed to be continuous through 
out the interval of integration The general solution based on these 
assumptions is sot as genera) as one might suppose A iew simple examples 
will eufiice to show this fact 

Example 1 Suppose a solution of the differential equation s: 0 

18 required such that y = 0 for x = 0 and x s: 1 Proceeding by the nsnal 
method we have 



Substituting the conditions given above, we find Ci = 0 and Ct = 0 Dence 
the solution is 

y-0, 

the equation of a straight line through the points (0, 0) and (1, 0) 

This solution is trivial and is not the only solution which will satisfy 
the given equation and the given conditions Since th“ solution must be 
of the form y = i4x + B, the graph of which is a straight line, it is evident 
(hat a solution might consist of two linear functions whose graphs would 
pass through the respective end points and intersect at some point x = s, 
as shown in Fig 37 We therefore attempt to find such a solution 
Let the two linear functions be 

( 1 ) y^^Ax 

'CouTM i^Analye MatUmaUque Tom* m (3rd edition 1923), pp 368 369 
* Aeta UalhmaUea Vol S4 {1910) pp 1SS204 
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and 

( 2 ) y2 = Cil — x), 

which evidently satisfy the respective end conditions. A third condition is 
that y, = y, at a: = s. Hence from (1) and (2) 

(3) As=:C(l — s). 

A fourth condition becomes evident when we look at the graphs in Fig. 37. 



The slopes of the two lines are different at the point of intersection, or for 
x — s. Hence the first derivative of the required function is discontinuous 
at a: = s, the amount of the discontinuity (difference of slopes) being any- 
thing we please but evidently depending on s. Call it k[s). Then 


(^0 


dyi 

dx 


^ = 4 + o = j-M. 


Solving (3) and (4) simultaneously, we get 

.4 = (1 — s)fc(s), C — sh{s), 

the arbitriiry "constants” A and C thus depending on s. Substituting in 
(1) and (2) these values of A and C respectively, we get 

(5) yi =:i-(s)(l — s)x, y- = fc(s)s(l — a:). 

In this and similar problems it is customary to put k{s) = 1. Hence 
the final solution is 


fy=(l — s)x for O^x-^s 
(y = s(l — x) for s^xgl. 
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4^4 

The reader will note that by discarding the nsual assumption of con 
tmnona denratim in this example we hare been able to find a worth while 
eolation which is ererywhere continnoos and eatisfies the giren boundary 
conditions On putting i(j) =sO in (5) we get the trivial solution first 
found The solution (5) is thus more general than the usual “general” 
solution. 

The solution (6) may be written as the single equation 
where 

f{r,a)z=(l — a)x for O^x^s 
ir(*,j)=8(l — *) for xgx^l 

The function Jr(s,x) is called Gretn’s Funcfion for this example It u 
a function of the two independent vanables x and s m the interval (0, 1) 
and IS evidently symmetrical m those ranables Green's function in this 
case IS thus the solution of the differential equation y"(x) with the 
given boundary conditions. 

jE^xafflf le £ Bequired the eolation of 

(1) jr(x)-a'y = 0, 

with the boundary conditions y s 0 when s = 0 and x s ] 

Solution By the usual elementary method of solving such equations, 
we have 

r* s a’, or r si * a. 


Hence the general solution is 

(2) y=:e.e~ + c,x^ 

= A cosh ox -|- B smh ox 

Substituting in (2) the values y = 0, x = 0 and y = 0, i = 1, respectively, 
we get 

0 = .d 


0 zz ii cosh a -I- £ smh a 

B smh a = 0, or £ = 0 (since we assume a 0) 
Hence (2) becomes 


another trivial solution 


y=^ 


To get a worth while solution of Uua example we assume a function of 
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the form (2) for each end point of the interral a: = 0 to s = 1. Hovrevcr, 
since cosh 0 yA 0, it is plain that the assumed functions need not contain 


cosh ax. Hence we take 

(3) yi = .4Binhca: and H sinh a(l ■ 


■x), 


where we have now utilized the bounder}' conditions in writing down these 
functions. See Pig. 33. The graphs of these functions will evidently 


Y 



intersect at some point where x = s, and at that point the functions will 
be equal and their first derivatives will be unequal. Hence ior x = s we 
have from (3), 

(4) A sinh = B sinh c (1 — s) 

/*'\ dt/i dvj , 

-jg- = Aa cosh as Ba cosh «(! — s) = i, say. 

From (4), 

(6) ^_ Hsinha(l — s) 

sinh as * 

Substituting this value of A in (5), we find 

sinh cs 

a sinh c * 
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Hcncc from (6), 

^ — *) 

asinha 

Substituting in (3) these >alaea of A and B, we get 

_ «nb a(l — j) 8inh ax 
a smh o * 

8iDhtt»smha(l — x) 

a smh a 

The«e can be written as a single solution in the form 
where 

,,, . Binhatl — #)8inhar . . _ _ 

A (s *) := 5 — for 0 < x < j 

a smh a " 

tor 

a Sinn « “ “ 

The reader will no*ice that Green’s function takes care of the boundary 
conditiors 

The following example shows how a differential equation with boundary 
conditions can be transfomed into an integral equation 

Example S Solre the differential eque*ion 

(1) g =/w 

subject to the conditions that y — 0 when * “ o and y — 0 when i = 6 
Soluiton From (J ) we hare 

* = =/.'«’** + 

and 

(2) y = X' (//«’)''•) lir -!■ A* + Cl 

At this point it 13 well to look at this double integral from a geomelnc 
standpoint 

The double integral may be looked upon as the 
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evaluation of the function /(s) over the region (area) ALP of Fig. 39, 
by first integrating over the vertical strip MN with respect to s and thcji 
finding the limit of the sum of such strips by integrating with respect to x. 
Since x and s are both continuous throughout the region ALP, however, 
the double integral may equally well be evaluated over this region by 


s 



integrating first over the horizontal strip RQ with respect to x and then 
finding the limit of the sum of these strips by integrating with respect to s. 


In this latter case the double integral would be T ( f* f{s)dx)ds. 
lienee we have 


( 3 ) 




It is thus seen that tlie substitution of an equivalent integral for the given 
one enabled us to perform one integration and thereby reduce a double 
integral to a single integral. 

Now replacing the integral in (2) by the single integral given in (31 
we have ° \ 



43.'> NIMERIC\L BOLLTION OF INTEGRAL EQUATIONS [Cka? X\ 

(4) ^~X + 

To find Cl and C, ve substitute m (4) the given boundary conditions 
I =: o, y = 0 and z = 6, y = 0 Hence we have 
0 = 0 + C,o + C, 

0 z= J^*{i->i)/{a)4fs + Cih + C, 

Solving these equations for Ci and C*, we get 

r*(6-a)/(s)& n r*(b-.)/{*)ds 

( 7 ,= — 

6 — a ’ b — a 

Hence (4) now becomes 

X r*(i~s)f(s)* a f‘(6-*)/(s)cU 

(5) , = /_ + 

= J/ (* - »)/(s)t ' f ' (i - !)/(«)* 

For the purpose o£ this ejamj i racsform the second integral by the 
well known relation /; =/>/; Then we have 

= X' (— ' + ))/W*+X,* 

or 

(6) sw = f ' &=5?^=^/(')* + X‘ 

which may be written 

where 

g(i,.) = oSiS* 

g(...) = for .a^Si 

Here, again, we note that ir(z,«) u symmetrical in x and 8 
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The final result (7) is a simple integral equation, and we have thus 
transformed a simple differential equation with boundary conditions into 
a simple integral equation. But we still have not found y; for in (7) 
y is expressed in terms of itself, the / (s) under the integral sign. 

It is instructive to check the correctness of (6) by differentiation. To 
do this we must use the formula for differentiating under the sign of 
integration. If 


then 


7(a)=j f(x,a)dx, 
J 


da 


Xl(o) 


8a 


da 


Applying this formula to (6) and treating x as a, we have 





6 


■/(s)ds- 


(a; — g) {x — 5) 
b — a 


fi^)> 


the second and fourth terms canceling each other, and 


dx' 





f{^) 


X 


a — s -j- b 
b — a 



fix) = fix), 


which shows that (6) is correct. 


138. Linear Integral Equations. We shall first consider the linear 
equation 

(1) <#>(x) =/(i) + ff'(i,t)^(t)dt. 

Since a definite integral can be closely approximated by any one of several 
quadrature formulas (each of which was derived by integrating a poly- 
nomial over an interval), it is evident that the definite integral in (1) can 
be replaced by a quadrature formula, so that (1) may be written in the form 

(2) ,^,(3;) =/(x) 4- ib — a)lC,Kix,t,)4,ii,) -\- C,Kix,U,)4>{U) • • • 

4 - CnKix, tn)fj>it„)'], 

vdierc • • • t„ are subdivision points of the interval (a, 6) and the 
C’s are weighting coefficients whose values depend on the type of quadrature 
formula used. And since (2) must hold for all values of x in the interval 
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{a, t), it must hold for * = f,, = , * = <» Hence from (2) 

we get n equations of the type 

(3) HU) =f(U) + ib-a)[C^K(t,.^,H(t,) +C,KiU,t,H<U) 

+ +C.K{l,,tn)HU)]. * = 1,2, n 

For brevity let us put =i>t and /(/«) =fi Then the system (3) 
becomes 

+ (6 <.)*, + c,ir(f., u)4., + 4- OnKiu, 

•j> =/» *f* f»)^« "l" ^*^'{^1, 4" ^»^(^*» ^»)^*] 

«, = /, 4. {6 - t,)H 4- CtK({., l,)H 4- + C^(U, f,)^. 

Equations (4) are a system of n linear equations in the it unknowns 
<^i, and can be solved for these unknowns by the usual methods 

for solving systems of linear equations After the ^’s hare been found, 
they are substituted in the right band member of equation (2) The 
result IS the desired solution of the given equation (1), since (2) will then 
give ^(z) for any value of z 

The reader r ill note that in a quadrature formula the functional values 
^1,^1 at the points of subdivision are given, whereas m integral 

equations these values must be found as part of the process of solving the 
equation \\» get the equations for finding them by putting x ss f|, f|, etc 
Because of the difficulty of solving a large number of simultaneous linear 
equations, it is highly de^irabk that only a small number of functional 
values {(fi’i) be computed In important problems the formulas of Gauss 
and Lobatto should therefore be used 

Example 1 Solve the integral equation 

^olufion Id this simple example we evaluate the integral by Simpson’s 
Rule, taking n = 3 or h = J Then 

(5) u(x) = f-i4-|- \ I E(f.4-*M(.) + 4((, + zMi,) 

Since (5) inu«t hold for alt *alues of z from 0 to 1, it holds for 
X = f„ fj, t, Hence from (5) we get 
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u[U)^ 


yi. 


18 


r[2fEJ(ii) 4- 4(rj-}- f-Xfo) -h {iz -f 


fJ \ 

”('4 = T' 


«(^:) - 


5f, 

(f 


Kotv' 'ovitling 


^ 4- 4 HzQuiu) -f (h -f 

V jS 

“ + --- [(^ -f t,)uitO -f Hh -f -f 2Uii{iz)l. 

lo 

fi =: 0. f; — i, <3 = 1 and writing n(fi) = v.-,, we get 


ii, = — I [2uj + U3] 

1.-3 = ^ [y2«i + 4ti3 + fei^s] 

Clearing of fractions and transposing the u’s to the left side of the equa- 
tions, we have 

36i!, — 411- — 2 u3 = — 4 

— Ui — 2Stl2 — Stlj 11 
— 2u't — 12«- 32^3 = 26, 

On solving these equations by determinants (Cramer’s Eule) or otherwise, 
vre find «i = 0, u~ — i, Uj == 1. Then substituting in (5) these values 
of the u’s and putting = 0, I; =• fj = 1, we get 

u{ir) = 1 4- i [0 -f 4(4 -f IS) (4) -f (1 -}- ir) (1)1 = ir. 

This result can be checked by substituting it in the integrand of the 
originr.l equation and performing the integration. Thus, putting «(t) =r f, 
VC have 



_ 

G 9 ‘ 9 ‘ 6 


Simpson’s Eule gives the evset result in this example because the integrand 
is a second-degree polynomial in t. 

Example £. Solve the integral equation 

(6) n(2) =2i-f i f*(ir— t)ii(f)dt 

o »/ -I 

by Gauss’s formula, using three points of subdivision. 
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SoluUon We mnat first traDsform the equation eo that the new liimts 
of mtegiation will be from — i to i Hence we put 
< = o4‘8f» xxze-{-du> 


Substituting in the first of these equations the correapondinglimite t =: — 2, 
V = — J and t = 3, V = we get a = |, b~5 Hence the equation of 
transformation is 


Likewise, 


*r=i + 6«p 


Substituting in (6) these Taluea of t and x, we have 


u(i + 5w) = 1 -f-lOK. + J*| (<£• — o)u(j4-5ti)5Jt 
Now put «(! + C«) ~ ^(w). «{i + Sw) —^(v) Then 
^(tu) = 1 + 10 k> 4- 5^ (x* — p)<^(i')iio 


Beplacing the integral by Oauss'e fonnola, we have 


(7) *(c)=l + 10tf 


Now since (?) must hold for all ealnee of w from ^ to it must hold 
for 10 = Vi, u> = 0 }, w = ft Hence on substituting in (?) these ralues 
for 10 we get the equations 

.^(v.) S2 1 + lOv, 4 * 5 [^»(*'| — ti,)^(v,) 4 - i?i(Vi— v.)«^(»i)] 
^(v,) =14- IOp, 4- 5[/?,(v, — »,)^(r,) +^,(»i — ti.)if(v,)] 
^(v,) = 14 - lOvi 4- 5(N,(o, — o,)*(F,) 4-i2t(v. — ti)*(p*)3 
For the Oau^s formula with three pointa of subdirision we bare 


= -lV|. >. = ». '’• = lVr. 


Ri = ^, Ri=^, R, = ~ 


On substituting these valnes in the equations abore and writing <fi, for 
^(Pi) etc, we get 


'f’f? 


* . _ 1 - V 15 + 5 [|(- * Vf) - Vf ) «.] 
= 1 + VT5 + 5 [A(Vf) +|-(j ^l^) ♦.] , 
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^ Vl5 4~ y/lS <i>i — 1 Vl5 
9) ■ — V15 4- ^2 V15 <^3 = 1 

A vTs <^i 4 -| vis ^3= — 1 — V15. 

.. 

Solving these equations by determinants, we find 


(19 + 9V15) 


<^2 


^3 = -^(19-9V15). 

As a partial check on the correctness of these results ive notice that by 
adding the first and third of equations (8) and comparing the sum vrith 
the second equation we get -f- <#’s = ^<p 2 , and this is true of the values 
found above. 

Now substituting in (7) these values of the ^’s, and the numerical values 
of the i?’s and v’s, we get 


Since tv 


-fZli 


, , . 180ia 38 

*M = -w-w 

, the final solution of (6) is ' 


, , 180 (x — i) 38 36x 56 4 

“'*> = W -X^-3r = lf-3»=37 

This solution can be checked by substituting it in the original equation 
(G), as shown below: 

=2x + |-J^^(s — t)^(9f — 14)d< 

“ lIsX — 14a: — 9t* + 14i) dt 

- =2x — — I— ^ = i_ (92; 14) 


37 87 37 37 
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139. Non*Liiiear Integral Equations and Boundarj-Value Problems. 
Many boundary-ralue problems lead to non linear integral equations of the 
type {3), Art 136 The untnown foncbon «^(0] “^7 »-ny func- 
tion of ^(Oi such as [^(t)]*, siD<^(t)f ®tc. In such problems the ^’s 
cannot be found by solving a system of simple linear equations as rras done 
in the examples worked in Art 138 It is possible, however, to find a 
system of equations which give the 4>'a in terms of the functions F[f, ^(t)] 
The ^’s can then be found by the process of iteration as was explained in 
Art 80 

Before proceeding with the solution of such non-lmear integral equations 
we return to a further discussion of boundary-value problems We con- 
sider first the second-order differential equation 

(1) y"(i) = ^ = JA{i), + f{i), 

With the boundary conditions ys=0 when z = a and y = 0 when xssl 
These conditions are usually written y(a) =y(t)ssO The functions 
A(r) and /(i) are assumed to be continuous in the interval {«,&), and 
X 18 an arbitrary constant or parameter 

Equation (1) can be reduced by direct integration* to the integral 
equation 

( 2 ) ,(.)=aJ_‘ Sr(.,5)A(.)y(.)d.+ J_“ jr(r, «)/(>)*, 

where 




but we shall here simply verify by diifercDliation that (8) is the solution 
of (1). Since X(x,s) has two different values, we write (2) in the 
equivalent and extended form 

,(i) = i J_' A(.)y(.)ifa + A J^* 

+ /■ + 

= X' + /(*>]■'' 

+ X.’ t>A(.M») + /W]'fc 


’ Lovett’s Lit 


Inteffral Equatt 0 n*, p St; Gcureat'e Court d’Anolfie, XU, p 49i 
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applying the formula for diSerentiating under the sign, we have 

[A.l(.)j,(,) + /(,)]* + M(=t)5(A + /Ml 

+ y |^M(5)y(s) + /(s)l*— f^^^(.'JiMjM+/Ml. 

the integrated terms canceling each other, and 

fix) = 0 -f ^[A4(a:)i/(a:) + /(=r)] + 0 _ |5^[A4(x)y(a;) -f fix)] 

= [AA(=E)y(x) -f /(a:)] 

= [AA(a;)y(i) -|-/(/r)] — y"" — ") j 

or 

f(x) =XA(x)y(x) -i-f(x), 
which is Equation (1). 

Let us now consider a more general boundary problem defined by the 
differential equation 

(3) ^ = f'ix) =F[x,^{x)^+gix), 


where E[i, <^>( 3 :)] represents any continuous function, gix) is a given 
function, and the boundary conditions are <#>(a) =^(6) =0. This dif- 
ferential equation with the given boundary conditions is equivalent to the 
integral equation 


(4) ^(a;) = {x. s) g (s) ds, 


where 


Kix,s)~ ^- — for a <5 <2; 

0 — a — — 

Kiz,s)=^ ~^)^^~^) for x^s^h. 


■We shall verify this feet by direct differentiation of (4). 
Writing (4) in. the equivalent form 
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= // +?(»))■<« 

+ // <'’[*■ + i'W>'*‘' 

Te di^erentiate the equation with respect to r, as m the preceding example 
Thus 

♦'W = J/ j~ ('’[». •»(>)]+ sWI* + (P[*, *(*)] + s(‘< 

+ X* lEl <'’[«■ *M1 + g(»))j. ” tPfe +sW). 

the integrated terms canceling each other, and 

•f"w = ” + lEj ♦<•'»+ «(')) + » - |Ej ('■[»> ♦(*)] + » W) 

= (p[.,«w]+5(*))(|E|-|5i) 

= (f[i, ,wj + 5(,))(|5i) = ,(,)) + 

as vas to be shown We therefore solve the differential equation (3) by 
solving the equivalent integral equation (4) 

Since It is desirable to hare a small number of equations for determining 
the <^’s, and yet a high degree of accuracy is desirable, ve restrict the 
function F[j;,^(r)] to the cases where F[a,^(a)3 =0 BndF[6,^(6)] = 0 
This restriction enables us to employ the subdivision points called for in 
Lobatto’s formula for five functional values, thus giving a high degr«« of 
accuracy and yet causing the two end values to drop out We thus have 
only three interior points to consider and therefore only th’ee equations 
for determining the ^’s Although we can use the aubdirision points 
required by Lobatto’s formula, we cannot nae the quadrature formula itself, 
because that formula was derived by integrating a single function through 
out the interval from x = a to z = b, whereas in the problem before us 
there are two different functions We therefore replace the function 
over the interval (o,b) by a fourth-degree polynomial given 
by Lagrange’s interpolation formula 

To adapt the interval of integration aa required for Lobatto’s pomU of 
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subdivision, \re must change the limits of integration to — f and as 
was done in Ex. 2, Art. 138. We assume that the interval has thus been 
changed. The subdivision points for Lobatto’s formula are then Si = 0, 

s* = iVW, s, = — i,s, = i. 


s,=—i S 2 = — iV3/7 $2 = 0 s 2 = W3/7 s, = i 


Lagrange’s formula for jP[s, <|>(s)] for these five functional values is 
therefore 

fs + iVy'jfs — (* + i)('S — i) 

(5) F[s,<l>(s)] = ^ > / -h 

(«(-!) 


(«) 


G-wi) 




xn-i 


(,) (s_W; 

1 ^ ' 


(- 

i(j 

I) 

{h 


f-i)' 



the terms in E[— ^)] and not being written because 

they are zero. When the terms in (5) are multiplied out, we get 

( 6 ) F [,, =112 



Equation (6) gives =0 and = 0 as it should. 

The ne.vt step is to substitute (6) in (4) and then integrate over the 
intervals ^ to J and x to using the appropriate value of K(x s) in 
each case. Thus, since a is now — .J and 6 is 4 we have 
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•'-H 

+ i)(»- + /w. 


where f{x) stands for J' K{T,s)g{x)ds and stands for the 

right hand member of (6) 

In carrying out the integration in (7), * is treated as a constant; and 
although the integration is perfectly straightforward, it is long and tedious 
The result is 



+ /(*) 


This formula (8) gives the complete solution of the integral equation 
(4), or the diSerential equation (3>, for any function F[£,i^(z)] as aoon 
as 4i$ are known 

To find these <^'8, we evalnate (8) for * = 0, ® = — iV|'> >^d 
x=i^Y Denoting by /(ii) by f,, etc, and doing some 

tedious arithmetic, we get 


(9) 




or, with decimal coefficients, 
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= — 0.075000000 ^(O,.^,) —0.025520833 F{—i'sjy,^:) 

— 0.025520833 .jf-s) + A 

<^,= — 0.032653061 F(0, <^.,) — 0.030952381 F(— <#-=) 

— 0.007142857 F(i "v/f- > + A 

IT 

^, = — 0.032653061 F(0, <#.0 — 0.007142857 F(— I <#>!) 
= — 0.030952381 U 

Since f{x) can be easily found in any given problem, the 4>’s can be 
found from (9) or (10) by the process of iteration if approximate values 
are knov-n at the start. Then the desired solution of (4) is found by 
substituting the 4>’s in (8). 

The reader should observe that in the special case where F[a:, <^(j)] 
=:^{x), equations (9) and (10) will give the in a system of linear 
equations as in Art. 138. A differential equation of the form 

4,"{x) =<f>{x) -{-f{x), 

with ^(fl) = 0, can thus be solved by means of (9) or (10). 

Example. Solve the differential equation 
(11) <|>"(a:) =sin<J.(a;) — 1. 

with the boundary conditions <f>{ — 4) =<^(4) =0. 

Solution. Here F[i,^(a:)] =sin^(a:) and £^(x) = — 1. Since <^(rfc -J-) 
= 0, sin^(±: 4) = 0 and we may therefore utilize equations (9) or (10). 

To get approximate values for <l> we assume that the solution of (11) is 
not very different from the solution of the similar equation 


(12) 

4>"{x) =<#,(!) — 

or 


(13) 

— — 1 . 


Solving this by the usual elementary method, we have 



r* — 1=0 or r=rt:l. 
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Hence the complementary function is 

jlcoshx-^ U 8\nhz 

To find a particular integral we assume Hence = 0 

Substituting these in (13), we get 

— C = — 1 Of C=1 
Hence the general eolation of (12) is 
(14) ^ = il coshx )- Bainhr + 1 

How aubstitubng in (14) the given boundary conditions ^{d:D=0, 
we have 

0 = COSH J — D Binh J + 1 
0 := /t cosh J + B sinh } + 1 
Solving these for A and B, we get 


Then (14) becomes 
(16) 


^s=l- 


cosh J ' 
coehx 


cosh i 


cosh 0 5 
cosh 


We now pulling i, = 0, i, = — i and e,x= Jljy 

m (16) Then 

„ = l_J^ = 0„3,8 

cosh 0 3273268 

cosh 0 5 cosh 0 6 

- 1054051446 

" 1127625965 “®®®^^^’^ 

cosh (iVy) 

i^bOy-=®®®S247 

The neit step is to evaluate the integral giving /(x) We have 

\ /(*)= f ff(x,s)y(jldj 

H 

i» we have 
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= - |J_^ (x-i)(s + i)d5+ i){S — I 

= - I (^-i)[|-+f]_^+(^ + D[|-|]_. I 


x~ 


8 2 * 


Heuce 


/{a;=)— g 8 ( 7 )“ 14’ 3 ( 7 ) 14 

Since ^[a:, <^( 1 )] =sm(^(a:), equations (9) become 


( 16 ) 


<j>i — — — sin <j>i 


49 


^2 — * 


16 

490 

16 


sin <j>i 


1920 

13 




420 

1 

140 


sin 4>2 ■ 
sin <f >2 - 
sin 4>2 ■ 


49 


1920 
1 


sin ^2 -f /i 


140 

13 


420 


sin (j >3 -f fs 
sin <^3 + /a . 


We now substitute in the right-hand member of the first equation of (16) 
the numerical value of /i and the approximate values of </>i, <f> 2 , 4>3 found 
above. Then we have 


3 49 

=-^sin(0.11318) sin (0.065247) 

49 

— sin (0.065247) -f 0.125000 

ly^u 

= — 0.0084704 — 0.0033279 -f 0.1250000 
= 0.11320. 


Now substituting this value in second equation of (16), we get 
sin (0.11320) — ^ sin (0.065247) 

— ~ sin(0.065247) -f 0.07142857 

=2 — 0.0036884 — 0.0020181 — 0.0004657 + 0.07142857 
= 0.065256. 

Also, 

0.065256. 
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We no» tepe&t the tbore proceea by eubetitatmg in 

the right band member of the first of equations (16) Then 

= -^Bm(0 11320) _^8in(0 06525G) 

“tHo Q852SS) + 0 ItSOOO 
= — 0 0084719 — 0 0033364 + 0 1350000 
= 011330 

Kow substituting this value id the second of equations (16), ve have 
^ (0 11320) _ ^ (0 065356) 

— sin (0 06S266) + 0 07142857, 

or 

= — 00036834— 06020m--00004658 +007143857 
= 0065356, 
and 

*,«> = 0 065256 

Smee these values of the ^’s are the same as the preceding set of values, 
we take them to be correct. 

The required solution of equation (11) is now obtained by substituting 
in (8) the values of ^ and /(*) found above Thus, since /(*) — ^ 

and F[0,^,], — i i replaced by 

Bin^i, sin ^ 1 , and sin^,, respectively, we have 

-f(oo«2io)(i-i4-S+gVf-i5iffV^+Is) 

^8 2 ’ 
or 

(17) ^ (*) = 0 11320 — 0 44352** — 0 03675** — 0 001443** 
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As a partial check on this result we find by substituting x — — f and 
x = i in (17) that <^(±: |) = 0 , as it should be. To check the result 
completely, it is necessary to go back to equation ( 6 ) and replace F(0, 

I -^/i, <#.-), and a) by 6 in<;)i, sin ^ 2 , and sin <^ 3 , respec- 

tively. The result is then substituted in equation (4). The integration 
is then carried out over the intervals — J to s and a; to the appropriate 
value of F (ar, s) being used in each case. Note that the second integral 


1 3 /^ 

in (4) is f(x) = - — which has already been found. This complete 


check has been carried out for this problem, the right-hand member of 
(4) giving the right-hand member of (17) above. 



CHAPTER XVI 


THE FORMAL LAW OF ERROR AND THE 
PRINCIPLE OF LEAST SQUARES 

140 Errors of Observation and Heasurnnent. Ail measniements are 
subject to three kinds of errors constant or systematic errors, mistakes, 
and accidental errors Sjsfematie errors are those which affect all measure- 
ments alike They are mosUjr doe to imperfections in the construction 
or adjustment of instruments, the “ personal equation ” of the observer, 
etc Such errors are usually determinate and can be remedied by applying 
the proper corrections 

JLfutakes or blunders are large enora due io careless reading of measuring 
instruments or faulty recording of the readings They consist mostly in 
reading th‘ wrong scale, reading a vernier backward, making a miscount 
in observations which involve conntiQg, putting down the wrong number 
when recording the readings etc Mistakes do not follow any law and 
can be avoided or remedied onljr by constant vigilance and careful checking 
on the part of the observer 

Aendentil errors are those whose causes are unknown and indeterminate 
They are usually small, and they follow the laws of chance The mathe- 
matical theory of errors deals with sccidental errors only 

141 The Law of Accidental Errors. In order to get a better under 
standing of the behavior of accidental errors the reader ahonld try the 
following experiment 

Take a sheet of ruled paper and draw with pen or pencil a line bisecting 
the space between two rulings near the middle of the sheet, as shown in 
Fig 40 Lay the sheet flat on a table or floor, with the rulings upward. 
Now take a sharp pointed pencil, hold it lightly by the top between the 
finger tips of both hands, and about two feet abov* the paper Take good 
aim at the line on the paper and try to bit it by dropping the pencil on it. 
Drop the pencil m this way at least 100 times, making an honest effort to 
hit the line every time The shots will be self recorded as dots on the 
paper Count the dots in the compartment (epace between the rulings) 
coataining the target line, and the munbei in each of the other com 
partments on each side of the central one Plot a curve by using as 
abscissas the distances from the target line to the midpoints of the 
several compartments containing dots, and as ordinates the nnmher of dots 
in the corres^nding compartments 
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An experiment of this kind gave the results recorded in the table below. 
These results are plotted in Fig. 41. 



Compartment 

No. of dots 

3 

1 

2 

6 

1 

31 

0 

53 

-1 

32 

-2 

6 

-3 

1 

Total 

130 



-3 -2 


o; 
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If the pencil had been dropped 10,000 or more times instead of 130 
and the width of the compartments correspondinglj decreased, the plotted 
points would hare followed the curre shown in Fig 41 This cnrre is 
known as the Normal Prohalihty Curve Its equation will be derived in 
Art. 143 

All kinds of accidental errors follow the same law as the pencil shots 
in. this experiment. 

142 The Probability of Frrors Lying between Given Limits. In 
many applications of the theory of probability it is necessary to find the 
chance that a given error will lie within certain specified Imuts In inch 
cases we ntilize the fact that the probability that an error hee untbtn yiven 
limits IS equal to the area under the probability curve between those limits 
The following proof, while not altogether rigorous, is snlficient to show 
the truth of this statement 

Going back for a moment to the target experiment of Art. 141, we recall 
that in plotting the resniU we erected ordinates at equal distances apart 
along the z axis The height of each ordinate was made proportions] to 
the number of dots falling vntbin the corresponding interrai on the target 
If we imagine rectangles constmeted with the equal inierrals along the 
z axis as bases and the corresponding ordinates as altitndes (see Fig 48), 


Y 
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we readily see that the area of each rectangle is proportional to the number 
of dots falling within the corresponding compartment. Thus, if is the 
number of dots in any compartment and At is the area of the corresponding 
rectangle, we have 

( 1 ) At = hNt. 

Now if we make one more attempt to hit the target line in the experi- 
ment of Art. 141, the chance of hitting within the central compartment 
is about 53/130, that of hitting within the next compartment to the right 
is about 31/130, etc. The chance of hitting Avithin some one of these 
compartments is therefore 

53 31 6 1 32 I 6 1 _ 130 _ ^ 

130 “*■ 130 + 130 130 130 130 130 130 

Since the chance of hitting within any compartment is proportional to 
the number of hits made in a large number of shots, we have for any 
compartment 

(2) pi — kiNt, 

where pt is the probability that a single additional shot will fall in any 
compartment in which Nt shots fell in a previous experiment. Eliminating 
Nt between equations (1) and (2), we get 

( 3 ) = 

which shows that the chance of making a hit in any compartment is 
proportional to the area of the corresponding rectangle. The chance of 
hitting within some compartment is thetefore 

(4) p = i = pi + p. + - • • = r + + - • •)=-r2A. 

Ki fCj 

Now when the number of shots is increased indefinitely and the width 
of each compartment on the target is correspondingly decreased, it is 
plain that the bases of the corresponding rectangles will likewise decrease 
and that the sum of the areas of .these rectangles will approach the area 
under the probability curve ns a limit. The area under this curve is 
always hnite, and since it represents the probability that a shot wiU fall 
somewhere, it (the area) represents certainty and therefore may be taken 
.as 1 ; or lim 2*4 = 1. Hence by (4) we have 
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Equation (3) now becomes 

(6) Pi = Ai, 

which shows that the chance of making s hit in any compartment is equal 
to the area of the corresponding rectangle 
From equation (6) we hare the important result that the chance of 
making an error whose magnitude Iiea between x and x-^-Ax is * 

( 6 ) P — yAx. 

where y is the ordinate to the probability curre The chance of makmg 
an error whose magnitude la between and Xt is therefore 

(7) 2IyAi= J" ydr 

143 The Probability Equation To derire the equation of the Proba 
bility Curre we make use of the following facts as to the distribution of 
accidental errors, as indicated by the table of Art 141 and the corre 
sponding curre 

1 Small errors ate more frequent than large ones, which shows that the 
probability of an error depends upon its site 
S Positive and negative errors of the same site are about equal in 
number, thus making the probability curve symmetrical about the y axis 
3 Very large accidental errors do not occur 
These three fundamental facts are so self-evident that they may be taken 
as axioms 

From axioms 1 and 2 it is plain that the ordinate to the probabibty 
curve must be a function of the square of the abscissa, or 

y = /(**) 

Here the function /(r*) is called the error /unction Our problem now 
18 to determine the form of this function 
Referring once more to the target experiment we can readily see that 
if we had aimed at a particular point on the target line the distribution 
of shots With respect to the line would not have been different from that 
found in this experiment Suppose, then, that we try another experiment 
of this kind and aim at some point 0 in the plane of the paper The 
ehots will be distributed about O m such a mannw that if we draw any 

* Ezetpt for differentisU cf hlgticr order 
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line through 0 the probability that any shot hits at a distance c from 
this line will be 

p = f(^)dc. 

Let us therefore draw through 0 any two lines at right angles to each 
other. We shall take these as axes of coordinates for two variables x and y. 
Let us consider any shot that falls at a point P{x,y). The chance that 
P lies in a strip of width dx at distance x from the y-axis is 

p^ = f{x^)dx; 

and the chance that P lies in a strip of width dy at a distance y from 
the i-axis is 

Pr = f(y^)dy. 

The chance that P lies in loth of these strips and hence in the small 
rectangle dxdy is therefore 

(1) p = p^p^ = f{3r)f(y^)dxdy. 

If we draw any other set of rectangular axes through 0, so that the 
coordinates of P referred to these axes are x' and y', we evidently have 

p,. = f{x'^)dxf, 

Pv = f{y'^)dy'. 

Hence the chance that P lies in the rectangle dx'dy' is 

(2) P' = fW^)f{y'^)dx'dy'. 

But the chance that this particular shot falls within a small area A 
is the same regardless of the orientation of the axes through 0. Hence 
if we take dx' and dy' such that 

dx'dy' = dxdy = A, 

we have 
or 

(3) /(^*)/(!/^) =/(x'^)/(y'=). 

Suppose now that the axes OX' and 01" are oriented so that OX' 
passes through P. Then 


Hence (3) becomes 


x'=Vx*4-y% y' = 0. 
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(4) /(xn/(y‘) = f(**+S*)/<0) = Cf(z* + y>), 

Since /(O) IS a ronstant 

Equation (4) is • funeUonat equation and can be solved by first 
differentiating and then integrating 

Differentiating (4) partially srith reapect to x* and y* in turn, we hare 

«*■)«»•) = 

Now since 0/(u -f* t)/2“ = ^/(“ + »)/d<. the right hand members of these 
equations are eqoa] Hence 


or 


r (*’)/(»’) = r ( y *)/(*’). 


«»>) M) ' ^ 


Multiplying the equation /'{x’)//(x*) = k through by li(x') and inte- 
grating with respect to x*, we have 

log«r(**) + log.f. 

or 

(5) f(x»)=ce^ 


Now since the probability of an error decreases as the sue of the error 
increases, it is plain that k must be negative Putting k = — A*, we have 


(6) /(x^lser^'*’ 
Hence 

(7) y = c<r»*** 


IS the equation of the probability curve 
To determine the constant e we utilize the fact that the area under the 
probability curve is equal to 1 Hence we have 

(81 l = 

This integral must be evaluated by an indirect method To effect the 
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evaluation let us consider the volume, of the solid of revolution (Fig. 43) 
included between the ly-plane and the surface generated by revolving the 
curve z = c"** about the z-axis. Since this is a surface of revolution, its 
equation is 

(9) z = 

In cylindrical coordinates this equation becomes 


( 10 ) 


z = e-^, where x--\-tf^z= r*. 



Taking as the element of volume a cylindrical shell of radius r, thick- 
ness dr, and height r, we have 

dF =: 2 tit ■ dr- z=z 

(11) F = 2rJ'^ e'"'>dr = — :rj’”e-^(_2rdr) z=_,r(e-'^] *’=«.. 

Using rectangular cordinates, we take as the element of volume a prism 
of base dxdy and altitude z. Hence we have from (9) 
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{12) V = i J .dtdy = i J^e i^’dxdij 

= 4j~ e^dx ^ e <^dy 

Ivovr since the value of a definite integral depends only on its limits 
and not on the variable of integration, we may replace y by s m the 
second integral l\e then have 

( 13 ) 

Since v.e have already found V = » above, we have 

,u, [./;,.v,]-=. 

Substituting this in (8), we get c = A/V» Now putting this value of 
c in (7), we have finally 

(143 1 ) 

as the equation of the probability curve 
Equation (143 1 ) is of /uncfamen/ul tm/wr/ance , for it is the foundation 
of the Theory of Errors the Principle of liesst Squares, and the Precision 
of Measurements It is known as the Probability Equation, Error Equation, 
etc and its graph is known as the Normal Probability Curve, the Error 
Curve, Gaussian Curve, etc 

It will be observed that this important equation contains only one 
arbitrary constant This constant A is called the “index of precision” 
To sec the reason for this name we notice that the larger A is the higher 
the probability curve will rise in the middle and the more rapidly it will 
fall on each side of the ' hump ” This fact when considered in connection 
with the target problem means that a large percentage of the shots hit 
near the target and very few hit far from it In other words, it means 
accurate shooting 

144 The Law of Error of a Linear Function of Independent Quantities 
We shall next prove a fundamental theorem of great importance, namely 
If il» are independent observed quantities whose laws of 

error are 



then any linear function of these quantities obejs a similar law of error 
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Proof: Let the linear function be 

F I ^ " 'Onilfnj 

where a„ O;, • ■ • On are arbitrary constants. If Xi, Xz,' ‘ denote the 
errors of Mi,Mz,- • -ilfn. respectively, and | denote the corresponding 
error in F, we have 

F 4 — (21/i + Si) + -{■ Xz) -{-■■■+ Oni^n + a^i) 

CtjAfi “h ^iXi “h “h ^2X2 "h * * ' On^n ~i~ XnXn . 

Subtracting (1), 

^2) 4 ” ^iXt "h Qz^2 “h ' ' * ^nXn • 

The error ^ in F is thus a linear function of the errors in Mi, Mz, etc. 
We arc now to show that the law of error for 4 is the same as the laws 
for Xi, Xz, etc. 

To simplify the proof we first take a linear function of two independent 
quantities, 

F “ diMi “h . 

Then 

f3) ^ = fli®! + 020 : 2 . 

Hence 

^ 4" — ai(Xi 4* Axi) 4" o.z{Xz 4" Ai 2 )* 

An error of magnitude Xi to x, 4- in Mi combined with an error of 
magnitude Xz to X 2 4 - ^2 in Mz will therefore produce an error of magni- 
tude ^ to I -f- Af in F. 

The probability of the occurrence of an error lying between x, and 
Xi -f- All in ilfi is 

Pi = c-»»*-i’Axi , 

Vt 

and similarly the chance of an error lying between x- and x- 4- Ax- in M, is 



The probability that these two independent errors will occur simultaneously 
end thereby cause an error lying between 4 and ^ -f A| in P is therefore 
the product of their separate probabilities, or 

_ Jiihz . • « . « « 

P = Pipz = . 


( 4 ) 
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This IS the probability that any single error in Mi combined with any 
single error in 3/, will produce a single error m P But equation (3) 
shows that an error in F may be produced by combining any value of ar, 
(that IS, any error in 3/*) with all possible values of Xi from — oo to 
4-« Hence the total probability of an error between t and 
the sum of these mutually eiclusive events, or 

(5) ^ Ax, J* *< » , 

where ^(£) denotes the error function for f 
Let ns now consider a single definite error £ m F This means that 
£ in (3) IS to be considered constant for the time being Hence from 
(3) we have 


Substituting this value of x, m (5), we get 

(6) ^ «)Af = 4«, J" "e W 'M'Ji. 

To simplify the integration, we transform and simplify the eiponent 
of e as follows 
Tor convenience we write 

Now expand the squared term and reduce the whole right hand member 
to a common denominator The result is 


- — a 


~ 0 ,' 0 ,* o,* 

Now multiply numerator and denominator of the first fraction on the 
right by a, 'hi* -{- a, 'hi* We then have 

p_ + (a.»V + a,»A.»?x/ gax.t.V 

o,*(B,*fc,* + q,*Ai*) o,» + a,* » 


which can be vnitten in the form 
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”1" fla'A.!*) fl2* 


+ 


2aiXi^h2~ 




or 


E = 




01*^2* -f- a2^Ai* 


02^ a2~{aiVi2~ + a2^Ai") ’ 

auA2= + a2V,r 

I Ci\^Jl2 


2aiXtih2‘ 


\ —A I '-A 

h,%2H^ fll=‘A2= + / _ 

01*^2* + a-^hi^ a2~ 


\ 

a==Ax==)V 


(®‘‘ ai='A2= + arAi= {ai‘h2^ + 

aOi2^k y 

ai~h2^ 4“ 02^ A/ / 

We now simplify this by putting (7* = Oi-A 2 " -f o>z^i- Then 

„ ArA2=^^ C‘ ( aji2^^y 

^ = C^J- 

The integrand in (6) now becomes 

g-We/C’-CC’/o^) 

which can be written in the form 

c-*iWU/c= . e-(C»/o,») (xi-oi/i,*{/c«)«_ 

Since the first factor is independent of Xi, it may be removed from under 
the integral sign. Then (6) becomes 


<#> (i ) Ai, ■ e-''.=»>’P/c= I e-(C’/02«) (x,-oa»,»£/c=)‘da:^ 

TT ^ 


Now put 

Then du= { 0 / 02 ) dx^, or dx^=i {a 2 /C)du, since ^ is constant. Hence 
</>(^)A$ = ^ ^ f "e-’du . 

IT C7J_„ 

B%it 

jj-'du = 2 ■ r-rf„ = 2 • ^ = VT, _ 

by Art. 143. 

C?) Ai;e-»i’**’e/o . ^ _ 

Vw 0 

We have now taken account of the effect of the errors x^ in in causing 
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6 patticul&T erroi { in F, eo that € is now a function of i» alone Hence 
from (3), regarding x, as a constant, nc get Snbstitnting 

this value for in (7) and replaemg C by its value Voi’Ai* + 
we get 


(8) 


<^(0 = 


Va.»V + gA»A.» 

V* 




(9) 

where 

( 10 ) 


Vir 




The law ef error for the error t« P, ii (Auj of the tame form as the 
laws of error for Xi and Xt the errors m M| end Mt 
From (10) we have 


( 11 ) 


1 _ ^ a,* ■ s* 


To extend this relation to a linear loactioa o! any sninber ol inde- 
pendent quantities, take 


F — UcHi Ojlli 4* ” (OjAli •4“ n»Af») 


If A| denote the precision index of the errors 
index for T, then by (11) 



in Utt snd H| the precision 




Id the same way, we can extend 4he formula to a linear function of 
4, 6, or any number of quantities We therefore arrive at the following 
result 


// F 6« a Untar funehon of n independent juanfities ipAtcA Aafe ieen 
determined by obsenaiioa the function F follous an error law whtek « of 
the same form as the error laws of the independent unlcnowns li the 
function IS 

F ~ Oiili Ojilt •)- fl«Af| cuAfg , 


the m&ex oi pieciswn, H, td F is given hy 


(IH-l) 
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Even when F is not a linear function of the independent quantities 
Ml, M 2 , • • • Mn, the error ^ in F vrill follow the Normal Law approxi- 
mately if the errors Xi, a;-, • • • x„ are relatively small. For let 

(12) F:=f(M„M2,- ■ -Mn) 

represent any function of Mi, M 2 , etc. Then errors in the M’s will cause 
an error in F according to the relation 

F f — f (Ml -}- Xi, 3/2 -}- X2, • • • Mn Xn)‘ 

Expanding the right-hand member by Taylor’s theorem, as in Art. 6, 
we have 

(13) F + i = f(Mi,M2,- ■ +^Xi-i-^X2-h- • • + 

-f- terms in Xi^, XiX^, etc. 


Now if a;i, a:-, etc. are so small that their squares, products, and higher 
powers may be neglected, we have after subtracting (12) from (13) 


(14) 


. SF , dF , 
^ “ dMi 0M2 


dF 


dMn 


which is a linear function of a:i, x-, etc. Hence by (122. 1) we have 


(144. 2) 



where M denotes the index of precision for the errors 


145. The Probability Integral and Its Evaluation. To find the proba- 
bility that an error of a given series will lie between the limits Xi and 
X, we merely find the area under the probability curve from x — x, to 
x = X:, as shown in Art. 142. This means that we must evaluate the 
integral 

The integral 

I = h C C e~^’'~^'d(hx) 


can not be evaluated in finite form, but we can expand the integrand 
into a power scries and then integrate as many terms as we need. Since 



Hence 
(2) / 
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i+*+|f+^+ +|j-+ . 

t* t* t* 

'•=‘-''+fi-5T+ir- 
- r* . <* 

"J.*’ 3’^5X2l rX3*'*’9X4r 


This senes conTergea rapidly for smal! ralues of t, and the error com 
mitted bj stopping at any term is less than the first term omitted 
{Art 12) For ezample, if < = i we hare 

f’* — 1 ■ 1 

J.* “ 2 24 "^320 5376 *^110592 

= 05 — 0 04167 + 0 00313 — 0 00019 + 0 00001 
= 0 46128 


This result is correct to the last figore, since the error is less tbsn 


U y 2703360 


=s 0 00000037 


For large raluea of t the series (2) is not conrenieat for purposes 
of computation, because too many terms are needed to gire the desired 
degree of accuracy We shall therefore derive an expansion in descending 
powers of t, which may be used when t is large 
Since 

J* "e *‘d( = J* ' e 'Vt + "e "dt, 

we have 

(3) J " 'it = J” — J" V>'Jt 

The value of the first integral on the right hand side has already been 
found to be Vr/2 Hence (3) become 

(4) r'dl = ^ _ J ..Ji 

Tte TBSMAiwiij Y2i*i;^n.\ ca tfeft vAt rm Ve •ffTA'i«i ■m thft itnm 

= J-i e<-(-2ldl) =_1 f - \ i(0 
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Integrating this last expression by parts, "by putting u = l/t, dv = d{e'*'), 
we get 

or 

J, ® ^^-2 i: ~‘l 1^+4 J, t* ^ ^ 

By continuing this process of integrating by parts and substituting 
limits, we get the following expansion: 

f” '*7^ ®'‘Vi 1,1-3 1-3 5 \ 

(5) ^ e at- ^ )' 

Substituting this in (4), we get 


This series (6) is called an asymptotic series. It is divergent, but the 
terms in parenthesis decrease in numerical value so long as the number 
of terms does not exceed P + 1 - This is the maximum number of terms 
ever used in computations with this series. The error committed in using 
(G) is less than the last term retained.* 

As an example of the use of (6) we shall compute 

C'e-*'dt. 

^ 0 

"We have 

Jo 2 4 V 8^64 612 ^ 4096; 

= 0.88623 — 0.0045789(1—0.125 + 0.046875—0.0292969 + 0.0256348) 
= 0.88623 — 0.0042044 = 0.8820. 


So« CliEUTent’i Sph«rioal end Practical Attronomy, Vol. I, pp. 166-156. 
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The error committed is less than 

0 0045789 X 0 MSfiSS = 0 0001174 
Ab a matter of fact the number 0 B820 is correct to its last figure 
B; means of formulas (2) and (6) one could compute a table giving 
the value of the probability integral for any value of i Such tables were 
computed long ago, and a table of thia kind is given at the end of this 
book This table gives the probability of an error lying between — t and 
-f t, where t = hx Since the probability curve is symmetrical with 
respect to the y axis, the chance that an error lies between — f and 4* ^ 
IS twice the chance that it lies between 0 and -f f Hence the probability 
of such an error is 

where f as Az The use of the table will be explained m working the 
examples in the next article 
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146 The Probability of Hitting a Target Suppose we take a rect 
angular target and draw through its geometric center two lines at right 
angles to each other and parallel to the sides of the target, as indicated 
m Fig 44 Suppose, further, that we set up this target in a vertical 
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plane at a convenient distance away and shoot at it 100 times with a good 
rifle. If the rifle is accurately aimed at the intersection of the dotted 
lines, the hits will be distributed symmetrically above and below the 
horizontal .dotted line and to the right and left of the vertical dotted 
line, just as in the case of the pencil hits described in Art. 141. 

If we take the horizontal line as x-axis, the vertical line as y-axis, and 
a line through the intersection of these and perpendicular to the plane 
of the target as z-axis, the hits will be distributed on each side of the 
vertical line according to the formula 


( 1 ) 


2 


Vir 


and they will be distributed above and below the horizontal line according 
to the equation 


( 2 ) 


2 — 


Vw 


The indices of precision and in the two directions may or may not 
be equal. 

Before we can apply formulas (1) and (2) to problems in target 
practice we must know the values of h~ and h,/ for the particular gun at 
the given range. The precision of a gun is indicated by its probable 
error or its mean error (see Art. 155), and these are determined from 
firings at the proving grounds. 

If r and denote the probable error and the mean error, respectively, 
we have (see Art. 155) 


Hence 

( 3 ) 


7i = 


0.4769 

r 


0.5642 

V 


hx =: 


0.4769X 

r 


0.5642X 

V 


Note. When using the probability table for the solution of target 
problems the student must keep in mind the fact that the argument for 
this table is kx, where x is the given or allowable error; but since 
Ax = 0.4769x/r = 0.5642x/j;, it is evident that the proper argument for 
entering the table is 

(a) 0-4769X 


when the probable error of the gun is given, and 
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,b) 

when the mean error of the gun u giren 
Example 1 For a certain 3 inch gun at a range of 4000 yards the 
probable errors were r« = 10 4 yards and r, = 3 8 yards Find the prob- 
ability of hitting at the first shot a rectangular target 18 ft. high and 
30 ft long 

iS'olufion The probabihty that the shot will land in a rertical itnp 
10 yds wide is 


P, = i f ' « = -5= f ’ 

Vw*'** 




I horizontal strip 


and the probability that the same shot will land i 
6 yds wide is 

The chance that the shot will land in both of these stripa and therefon 
hit the target is 


But 
by (3), and 


p=p.p,=-7=r'* x-7=r'« ""''iM 

. 0 4769y_ 0 4769X3 




58 


;0 247 


Entering the probability table with these ralues of hx as arguments, 
we &d 

F, = 0 254, F, = 0 273 

Hence 

P =z P,P, = 0 254 X 0 273 = 0 0693 


It would therefore require on the average about 1/0 0693 = 15 shots to 
get a single hit 

Example £ The mean erron for a certain gun at a range of 3000 
yards are 

= 8 3 yds , ^, = 46 yds 

If 30 shots are fired at the s de of a house 12 yds wide and 6 yds high 
at a distance of 3000 yards, 
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(a) How many hits may be expected? 

(b) What is the chance of hitting a door 6 ft. X 3 ft. in the lower right- 
hand corner of the side of the house ? 

Soluiton. (a) If the gun is accurately 'aimed at the geometric center 
of the side of the house, any shot will be a hit if it passes within 6 yards 
of the central vertical line and within 3 yards of the central horizontal 
line. Hence we have 

x = 6 yds., y = 3 yds. ; and 

= 2:5^ =»A6||><i= 0.407, 

i,, = 2:5^ = 0.368. 

4.6 

From the probability table we find 

P* = 0.435, = 0.397. 

The chance of a hit for each shot is therefore 


P = P,Py = 0.435 X 0.397 = 0.173. 

For 30 shots the number of hits would probably be 30 X 0.173 = 5.2 or 
5, say. 

(b) To find the probability that the door would be hit during the 
bombardment we assume that the gun is aimed at the geometric center 
of the side of the house, as in (a). Then th? door will be hit if a shot 

strikes within the rectangle bounded by the lines x = 5, x = 6, y = 1, 

y = — 3. The chance of hitting the door at each shot is therefore 


P= P,- P, = X 4= 

" y/trJi 


Hence the two values of h^x to be used in the probability table are 
X 6 = 0.407 and —gj- X 5 = 0.340, 
for which the probabilities are P« = 0.435/2, P„ = 0.369/2. Therefore 
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0435 . 0369 _ 0066 
% 2 2 

Likewise, the two values of are 

»^X3 = 0368. «^xl=0m6 
The corresponding probahilities are found from the table to be 
„ 0397 p 0138 

p,.=— . — 

Hence P, — 0 397/2 — 0 138/2 = 0 1B9/2, and we have finally 

^ ^ ^ 0 066X0159 

P = P. X P. = ^ = 0 0026 

The door will be hit unless every one of the 30 shots misses it The 
chance that any shot will mias it is 1 — 0 0026 =: 0 9974 The chance 
that every one of the 30 shots misaea is therefore (0 9974)” = 0 9249 
The chance of a hit is therefore 1—09249 = 0 0751 
The door would probably be hit once out of the every 1/0 0026 = 360 
shots 

Example S Find the number of diots necessary to make the odds 10 
to 1 in favor of at least one hit on the side of the bouse mentioned m 
Example 2 

5olu(ton The house will certainly be hit at least once unless every 
shot misses it The chance that any shot will be a hit was found to be 
0173 The chance that any shot will miss it is therefore 1 — 0173 
= 0 827 The chance that every one of n shots will miss it is then 
(0 827)" The chance of at least one hit is therefore 

P = l — (0 827)- 

Since the odds are to be 10 to 1 IQ favor of a hit, we have P =: 10/11 
Hence 

1- (0 827)- = 32, «t (0 827)- = i 


or 


nlog (0 827) = — log 11, 


_ — logll _ —10414 
log 0 827 9 9175 — 10 


— 10414 

— 0 0825 


= 12 6 = 13, say 
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147. The Principle of Least Squares. Suppose we make a set oJ n 
measurements Wi, m 2 , • • oi some object or quantity in an effort to 
determine as nearly as possible its true magnitude, using the same care, 
methods, and instruments in making each measurement. If we try to 
read the measuring instrument to the finest subdivision of its graduated 
scale and even estimate fractions of a subdivision, we shall find that the 
results of the several measurements do not agree exactly among themselves, 
however much care we may use ; for each measurement is subject to unavoid- 
able accidental errors. How, then, shall we decide upon the best result 
obtainable from any given set of measurements or observations? 

This question is answered by the Principle of Least Squares, which 
says that the best or most probable value of the measured quantity is 
that value for which the sum of the squares of the errors is least. This 
answer is in accord with reason and common sense; for, since the acci- 
dental errors are real quantities their squares are positive quantities and 
the requirement that the sum of these positive quantities shall he as small 
as possible insures that the errors themselves shall be as small numerically 
as possible. 

Furthermore, the requirement that the sum of the squares of the errors 
shall be a minimum leads to the result that the arithmetic mean or 
average of the measurements is the best value obtainable from any set 
of equally trustworthy direct measurements. This result is also in accord 
with experience and common sense. 

The principle of least squares also follows from the Normal Law of 
accidental errors, as we shall now show. 

If we make a set of measurements all with equal care and use the same 
methods and instruments for each, the precision constant h of the prob- 
ability equation will be the same for all the measurements and the fre- 
quency of the accidental errors will be given by the same probability curve. 
If the accidental errors of the n measurements Wj, m,, • • • m„ be denoted 
by Xj, I., • - • x„, respectively, then the respective probabilities of these 
errors are 

Pi r= -^e-’''=i‘dx„ Pi = ■ • • p„ = . 

V-JT Vw Vtt 

Since the separate measurements are independent events, the probability 
that the set of errors Xi, Xi,' • • Xn wiD be made is the product of their 
separate probabilities, or 

(1) P = p,p2- • = dxidx,- • -dxn. 
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Now Since small errors occur more frequently than large ones, a set 
of small errors is a more probable eaent than a set of large ones in 
making any set of measurements Hence the set which has the greatest 
probability will give us the best or most probable value of the quantity 
measured, and since the differentials rfr„ dx-, etc are perfectly arbitrary 
quantities (the smallest subdivisions of a graduated scale, for instance) 
it is evident from equation (1) that this probability P is greatest when 
the exponent of e is least, that », when 

*,* -}- X,* ^ -J- X,* = ** A minimum. 

Thus, by the pritieipics of probability we arrive at the PnnapU of 
Least Sguares, namely 

The best or most probable value obtainabU from a set of measurements 
or obseriattons of equal precision is that value for which the sum of the 
squares of the errors w a minimum 

Note Any measurable quantity has a definite, true magnitude, and 
the differences betueen thw unknown magnitude and the several ttieuute- 
ments made to determine it are the true errors of those measuremeats 
However, when these errors are required to satisfy the condition that the 
sum of their squares shall be a minimum, for the purpose of arriving at 
the most probable magnitude of the quantity, they become residual errors, 
or simply residuals (see Art 14d) But it is shows is Art 151 that the 
sum of the squares of the residuab is least when the sum of the squares 
of the errors is least 

148 Weighted Observations. If the measurements are sot of equal 
precision, the values of k wiU be different The probabilities of the errors 
will then be 

h, h, A. 

p, = (fr„ = p, = e di, , 

and the probability of their simultaneous occurrence will be 

h,hs K 

(1) P = p,p, p. = e dx,. 

The best value obtainable from this set of measurements wiU therefore 
be that for which 

(8) + ^ 1 ^** + +h,*z,* IS a minimum. 

Since it is not customary in practice to make such an expression as 



Abt. l^bi 




*±# t 


(2) a minimum, it is necessary to introduce here the idea of weighted 
measurements or observations. By the weight of an observation is meant 
its relative value or importance when compared with other observations 
of a set. Thus, if we measure a line three times with the same care and 
accuracy, we regard the mean of the three measuremeents as more reliable 
than any one of the single measurements. We express this by saying 
that the weight of the mean is three times that of a single measurement. 
An observation of weight lo is therefore one which is equivalent in impor- 
tance to w observations of unit weight. 

To find the relation between weight and precision index let 
A = precision index corresponding to weight 1, 
hx = precision index corresponding to weight Wx. 


Then the probability of an error of magnitude x in the observations of 
unit weight is given by 

h 

p = — 7=e-*'^V2:; 

^ Vtt 

and the probability of an error of the same magnitude in a set of observa- 
tions of weight Wx is 


Vx — 


hx 

—= e''''^^dx. 


The probability of the same error (of magnitude x) in Wx observations 
of unit weight is 

/ h XuJi 

P = p- p - p- ■ ■ to Wx factors = = I . 


Now if the weighted observation (wt. Wx) is to be worth as much as 
the Wx observations of unit weight, an error of magnitude x must have 
the same probability in it as in the case of the Wx observations. Hence 
we must have 

Px^P, 

or 

hx / h \vsi 

- dx^ J 

for any x. Taking logarithms to the base e, we have 

/i 

y- — = “'i — mh’x- ^(wx — 1) log, dx. 
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Equating coefficients of like powers of x 
Al* = Wl&*, Ot 

Ltkei^ue, for observations of weights Wt, tCj, etc., we have 
A,* = »iA*, or tt* = ^ , 

A,*=tw,h*, or ID, 
etc. 

The weights are therefore pToporhonal to the squares of the precuioA 
\ndiets 

Substituting in (1 ) the values of A,*, A,*, etc u given above, we get 

Ji,, 

In order that P be a maximam we most have 

(3) 2«'^* “ *‘’1*1* + “’»*»* + + «**•* A nHDimnio 

Wc can novi state the Principle of Least Squares m lU moat general 
form 

7Ae best lalue of an unknown quanlUg that can be obtained from a set 
of measurements of unequal preewon ts iAat wAicA makts tAa sum of tAt 
weighted squares of the errors a rntnimum 

149. Residuals. In the preceding articles of the present chapter we 
have been discussing the errors of observations and measuTementa The 
true or exact magnitude of a quantity can not be found by measurement, 
for the unit of measurement and the quantity to be measured are, in 
general, incommensurable Horeover, all measurements are subject to 
errors of some kind It is obvious, therefore, that the error of a measure* 
ment can never be determined, the error being defined as the true value 
minus the measured value What we actually do, and all we can do, is to 
measure the quantity as many times as may be desirable or convenient and 
then find from these measurements the most probable value of the measured 
quantity The difference between the most probable value and any particu* 
lar measurement is called the residual for that measurement For con- 
sistency in sign we always write 

Error = True Value — Ueasored Value 

Residual = Most Probable Value — Measured Value. 
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Let mo denote the most probable value of a measured quantity and let 
mi, ms,- - -m„ denote the values of n separate measurements. Then if 
Vi, V 2 ,- • -Vn denote the residuals of these measurements, rve have by 
definition 

Vi = mo — mi, 

Vs = nio — ms. 


•On = mo — m*. 

' 150. The Most Probable Value of a Set of Direct Measurements. The 
definition ' of residuals leads us up to the problem of finding the most 
probable value of a set of measurements. Suppose vre make n direct 
measurements on some unknown magnitude, how shall we determine the 
best value of the magnitude, on the basis of the n measurements? To 
give a general answer to this question we shall first assume that the 
measurements are of unequal weight. 

Let mi, ms, • - • mn denote the n measurements and let w,, mj, • • • tVn 
denote their respective weights. Then if m denote the true value of 
the unknown magnitude, the errors of the several measurements are 


•Cj fjt ‘ Ttt • 


Now the true value m is xmknown and can not be found, but we must 
adopt some value for it. The principle of least squares says that the 
best value is that which makes the sum of the weighted squares of the 
errors a minimum (Art. 148) ; that is, 

(1) /(m)=u!,(m — mi)*-J-Wi(TO — m,)^'-}-- ■ ■-j-m„(m — m»)* 

must be a minimum. 


Differentiating (1) with respect to m, putting the derivative equal to 
zero, and replacing m by mo, which is to be the adopted value of m, 
we have 

mi(mo — mi) -f mi(mo — m,) -f- • ■ + u)n(mo — m„) =0, 


from which 
(150.1) 


Wim, + Wsms -f • • - + w„m„ _ ^mm 
tUi + roj -4- • • • 4- " 2,10 ‘ 


This value mo is called the weighted mean of the several measurements. 
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If all the measurements are of equal veight, then 
and (150 1) reduces to 


(160 2) 




=z U», = = 


which js simply the auragt of all the measurements This result is in 
accord with experience and common sense 
Formulas (150 1) and (ISO 2) enable us to prove the following im 
portant theorem 

In any set of meaaurementa of oqLol wetght the algebraic sum of the 
residuals ts stro, and in a set of measurements of unequal weight t^e 
at^eSraic sum of the weighted residuals tS zero 
To proie this theorem let m, denote the most probable value of the 
n measurements ffli, mt, fR«, andlet Vi, Vj, v. denote the residuals. 
Then 

W, = »»« Ml, 

tj ~ m, — inj, 




Adding these n equations, we get 

Fi + t>i+ +u,=snm»— (m, 4-»n, + +m») 

s=nm**— i»m*sO, by (150 2) 

To prove the second part of the theorem let Wi,Wi w» denote the 
weights ol the several measurements The weighted residuals are 
= w,m, — u»,m, , 

WzVt ^ — v^mt , 


Adding these n equations, as before, we get 

u>,v, + u>jOi+ tp.ii* = m»(tti,+ip,+ w,) — (ui,mi-f t£i,mj+ ) 

= 0, by (150 1) 

This theorem provides us with a valuable check on the computed 
residuals in any set of measurements However, since the residuab in 
such cases are rounded numbers their algebraic sum will rarely be exactly 
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151. Law of Error for Residuals. We shall now show that when the 
errors of a set of measurements follow the Normal Law of error, the 
residuals likewise follow a similar law. To prove this let m denote the 
true value of the measured quantity; mo the most probable value; ci, £ 2 , ■ • • £n 
the errors of measurement ; Vi, Vo,' • ’ v„ the residuals ; and Wj, Wo, - • ’ 
the weights. Then 


i^) 

Vi = mo — fUi , 
Vz = mo — mj , 

v„ = mo — m„ . 


(0 

£1 =: m — mi , 
C 2 ITt ' 7712 f 

Cn 771 771b , 


For the case of measurements of equal weight we have from column (v) 

2™ 


= nmo — 2^ = 0, or mo: 
and from colunrn (£) we get in a similar manner 


n 


2£ = nm — 2^j or 2^ = R™ — 2«- 


Substituting this value of 2m in the equation mo = 2m/n, we get 


( 1 ) 


mo 


nm — 2e 


n 


= m ■ 


n 


Now substituting this value of mo in the equations of column (n), we have 




We have thus proved that the residuals are linear functions of the errors. 
Hence by Art. 144 they follow the Normal Law. 
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If A u the precision index for the end B that for the v% we hare 
from (144 1) 

^ = — fr— +xr+ + 

or 

_1 It — 1 1_ 

^ “ II ** 

Hence 

(3) B = h-\I^^ 

Since the residnala follov the Normal lav, the probabili^ equation 
for them ]g 



From (3) )t la plain that the precision index for the residnals la a 
fnaetion of both A and n, and that it u alwajri larger than A Thu 
means that the graph of (4) rises higher in the middle and falls off 
more rapidlj on each side than does the graph of (143 1) ^s the 
number of measurements increases, the graph of (4) approaches that of 
(143 1} more and more closely, and would nltimalely coincide with it if 
the number of measurements were increased indefinitely 
When the measurements are of unequal weight, the weighted residnals 
and weighted errors are as giren m the columns (ton) and (tn<) below 

(icn) (i«) 


w,n, = uijm* — , 


W,*, = tn,J7l tDtffli , 


On adding the equations (icv) we gel 

— fn#2w — 2w"* = 0, by (160 1) 

/ 

By adding the equations in column (wc) we obtain 

= in 2“^ — 2®*n, or Swm = m 2w — 2®* 
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Subatitnting this value of Swm in the expression for mo above, vre get 

m^to — ^iVe '^We 

(5) mo _ 210 

Hence 


• = m- 


■ 


^6) '■ V\ mo m^ ~ — ■ m m, £i * 


= ej 


Witl 


W-c» 




■ 2«' 
Wnin 


01 


Similarly, 


2w Sw' 

tOl \ «>2 M’s 

2«’'^ 




iVn 


'2w 




V2=. 


to. 


etc. 


2«; 


<x + I 1 


(-S) 




li’n 


C2 ■ 








Hence in the case of measurements of unequal Treight the residuals are 
linear functions of the errors and therefore follow the Normal Law. The 
residual Vi, for example, would follow the law 


where 


V’n* 


1 __ 1 r(2«> — wiY ■ I !£il1 

ho® + ■ ■ h„®J 


And similarly for the other residuals. 


On squaring and adding the n equations t;i=:ei — (l/n)2£, V 2 = <3 
— {l/n)2<, etc., we obtain 

(7) = 

7i 

which gives the relation between the sum of the squares of the residuals 
and the sum of the squares of the true errors in any set of measurements 
of equal weight. Since both terms in the right member of (7’) are 
positive quantities, it is evident that the sum of the squares of the residuals 
is always less than the sum of the squares ,of the errors, but that the 
difference is very slight. 

Inasmuch as the quantity S« is very nearly zero in any set of measure- 
ments, the square of this- quantity is' still smaller and (l/n)(2€)® is 
practically negligible in comparison with 2«®. , Hence any Bmr.U shift 
in the values of the * wo^d have very little effect on the already 
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negligible quantity (l/n)(Z()' We may therefore consider this quantity 
constant for email changes in the and then it is plain that Zu* is 
least when Ze* is least 

This can also be shown in a different way From equation (7) we hare 

2 »> = 2 .’ — 

^ 2 («!* + *»* 4* -f- <«* -f- 2«l« -{- 2t» It.) 

Now when the number of measurements is large, the product terms 2(t(2, 
3<\<2, etc will be about half positive and half negative, and they will 
average about the same sire Hence they will cancel one another for the 
most part and then Sv’ reduces to 

2^1 _ 2** (*«* 4- «t* + 4~ «#*) 

= 2 .'-^ = (! 1 ^) 2 .- 

From the foregoing considerations we are justified in asserting that 

Tht sum c/ the squares of the restduals « a mvaimurv uihtn the sum of 
the squares of the true errors ts a mtntmum, and conversely 

In a similar manner, on squaring the n equations Vi = ii — >7v</Sta, 
vj <2 — Zu'e/Sta, etc , then multiplying the squared equations by the 
corresponding weights it>„ te,, etc and adding the results, we get 

( 8 ) 2 »»' = 2 «>.’-^( 2 ».)- 

Here, again, we see that the sum of the weighted squares of the 
residuals is a minimum when the sum of the weighted squares of the true 
errors is a Tninimum, and conversely, evnee the negligible quantity 
(l/Su') (Su>c)’ may be considered constant for small changes in the t’s 

Remaris Equation (1) shows that the arithmetic mean is equal to 
the true value of the quantity minus a very small quantity, for since the 
errors are as likely to he positive as negative the quantity 2< is not large 
eml w. afjJi amaJJac tba. tb/i. wunha-i <i£ uiRaania 

menU the nearer does ntg approach the true value o! the quantity measured 
Equation (5) shows a similar result in the case of weighted measurements 

Equations (2) and (6) show that any residual is equal to the coire 
spending error minus a very small quantity Therefore when the number 
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of measurements is large the residuals are practically equal to the true 
errors. Hence, although we can never determine the true magnitude of a 
measured quantity we can determine it as closely as we please by taking 
enough measurements. 

152. Agreement between Theory and Experience. At the beginning 
of this chapter we described an experiment which was designed to show 
the behavior and distribution of accidental errors. In deriving the Prob- 
ability Equation we made the assumptions that the probability of an error 
depended upon its size and that positive and negative errors of the same 
size were equally likely. These two assumptions were supported by the 
pencil experiment. The first is based upon experience, but the second is 
evident on purely fl priori grounds and also supported by experience. No 
rigorous deduction of the Normal Law, based upon purely a priori con- 
siderations, has ever been given. The truth is that, for the kinds of errors 
considered in this book (errors of measurement and observation), the 
Normal Law is proved by experience. Several substitutes for this law 
have been proposed, but none fits the facts so well as it does. 

To show how well the Normal Law agrees with experience when the 
number of measurements is large, we give in the table below the results 
of 470 observations made by Bradley on the right ascensions of the stars 
Sirius and Altair. 


Size of errors 

Number computed 
from theory 

Number actually 
found 

O'.O to OM 

95 

94 

OM to 0',2 

89 

88 

0'.2 to 0'.3 

78 

78 

0'.3 to 0'.4 

64 

58 

0'.4 to 0'.5 

50 

51 

0'.5 to 0'.6 

36 

36 

0'.6 to 0'.7 

24 

26 

0'.7 to 0'.8 

15 

14 

0’.8 to 0'.9 

9 

10 

0'.9 to I'.O 

5 

7 

over I'.O 

5 

8 


It will be seen that the agreement between theory and experience is 
remarkably close, with the exception of the number of errors of magnitude 
from 0".3 to 0",4. 
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1 Compute the vjilue oi the jnlegral to seren decusal 

places. 

2 Compute the xalue of J**e ‘‘dt correct to four decimal places 

3 Find the probability of hitting at the first shot a rectangular target 
SO Jeel "Wide and 24 leet hig^ at a distance ol yards, tie mean errors 
for the gun at this range being 

i7» = V4yds, ^^SSyds 

4 . If 10 shots are fired at a cylindrical standpipe 120 feet high and 40 
feet in diameter at a distance of three miles, find the chance that the 
standpipe viU be hit if the probable errors of the gun for this range are 
r,s= 14 2 feet, r, = 10 6feet 

5 If the foretop of a batUe^ip is a cylinder 12 feet is diameter and 
8 feet high, find the chance that it will be hit by a shot aimed at a point 
80 feet directly below, the mean erron tor the gun ja this case ^ing 

ij4s42 6fee^ ilvsSSSfeet 

About how many shots would hare to be fired at the ship (aimed at % 
point 80 feet below the foretop) before the foretop would be bit? 

6 Twelve measurements of the length of a line are given below Find 


the most probable length of the line 

304 2 364 2 3613 

364 4 363 7 363 8 

363 9 364 1 364 3 

364 3 364 5 364 0 


7. Seven measurements of an object by different methods are given in 
the following table It the weights of the different measurements are as 
given in the table, find the most probable size of the object 


Measurements 

Weighta 

369 2 

2 

36S 3 

I 

371 1 

3 

370 2 

£ 

369 1 

2 

370 e 

4 

372 2 

1 


Compute the lesiduaU and weighted residuals Find the algebraic sum 
of the weighted residuab and the stun of the weighted squares of the 
reaiduela. 
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153. Measurements, Direct and Indirect. Direct measurements are 
those made by methods and instruments whose indications give directly 
the quantity sought. Such measurements are usually made by reading 
a scale graduated in terms of the chosen unit. Yard sticks, clocks, 
voltmeters, chemical balances, etc. are instruments for making direct 
measurements. 

Indirect measurements are those in which the quantity measured is not 
given directly by observation or readings taken, but must be calculated 
from them. Thus, in an indirect measurement the quantity sought is a 
function of one or more directly measured quantities. For example, if we ■ 
measure two aides and the included angle of a plane triangle. we can find 
the remaining side and vhe area by means of the formulas 

a = V 5® + c® — 26c cos A, Area = sin A. 

Here the directly measured quantities are 6, c, A, and the indirectly 
measured (computed) ones are a and the area. 

The relation between observed and computed quantities may be expressed 
by the general formula 

y = ^2,3^3,- • -o, 6,c,- • •), 

where y and the St’s represent observed or computed quantities and a, 6, c, 
etc. represent numerical constants. 

164. Precision and Accuracy. The words “ predsion ” and “ accuracy,” 
when used in the discussion of measurements, have quite different meanings. 
Precision has to do with accidentaX errors, and a precise measurement 
would be one free from accidental errors. An accurate measurement, on 
the otlier hand, wo\ild be one free from all kinds of errors — mistakes, 
systematic errors, and accidental errors. Barring mistakes, the systematic 
error is thus the difference between the precise value and the accurate or 
true value of the quantity measured. If the systematic error should 
happen to be large, a precise measurement might be very inaccurate. The 
accuracy of a measurement can be increased by using more refined instru- 
ments and methods, whereas the precision can be increased only by using 
more care in making the measurement. 


4S7 
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1 DIRECT MEASDREMEHTS 

159 Measures of Precision The precision of a measurement can be 
estimated in several w&js The three measures of precision in common 
use are the following the mean square error (use), the probable error 
(p E.), and the overnje sttot These three measures are denoted by the 
letters r, and 17, respectively We shall now derive expressions for them 
ID terms of the precision index k 

(a) The Mean Square Error (u a b ) In discussing the error equation 



in Art 143, we stated that A is called the index of precision and indicated 
the reason for this name Then in Art 147 we found that the probability 
of the simultaneous occurrence of a set of errors Zi,Zt, x» in a given 
measurement is 

(I) p=p,p. p.=^iy.>«<.''-^ ••■'ijj.iii. jj. 

It was also shown in that article that the best or most probable result 
obtainable from a set of measurements is that corresponding to the 
maximum value of P 

Let us now assume that a given set of n tneasurements has been made 
and let us try to dad the best or most probable value of the precision 
index A for this set of measurements It is that value which makes P a 
maximum and is found by diSerentiating P with respect to A and putting 
the derivative equal to zero We thus get from (1) 



or 

+*.') + »]=o 

— 2A*(x,* + *,* + + *,') 4- n = 0. 

or 

W ■” n ’ 


2 N 


from which 
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The quantity on the right is usually called the mean square error 
(m.s.e.) of a single observation and is denoted by the Greek letter fi. 
We therefore have 


(2) 




AV2 


=v 


II- X-..- -4- • • • -]- x„- 


(h). The Probable Error (p.e.). The probable error, r, of a single 
measurement of a series is a quantity such that one half the errors of 
the series are greater than it and the other half less than it. In other 
words, the probability that the error of a single measurement will fall 
between r and — r is and the probability that it will fall outside these 
limits is Hence we must have 



e-^'^^dx =z\ , 


r = 


T_ 

4 


9 


since the probability that an error lies between any given limits is repre 
sented by the area under the probability curve between those limits. 

To find the value of r from the above equation we put 


Then 

and we have 


i = hx. 
dtx=.h dx, 


Now 



or 



e-m = 0.4431135, 


where p — hr. 






' 24 
24 



dt z= 0.4431135, 


(3) 



+ — ■ 
10 


P_ 

42 


216 


1320 


— 0.4431135 = 0. 


This is the equation which we have already solved in Art. 75 and found 
p == 0.4769363. The value of p can also be found by interpolation, as we 
have already done in two ways in Ex. 2, Art. 27 and Ex. 1, Art. 34. 

Using now the relation p = hr, we get 


- _ P _ 0.4769 

^ ~ h~~ h 

and from (2) we have 
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Hence 


or 

(*) 



r = 04rG9V8 + ±Il 

= 0 6745 ±£s! , 


r = 0 6743 JV. + ^V+ -, ■ + ^* 

’ n 


(c) TAe average error is the arithmetic mcsn of all the errors o! a 
set, vithont regard to signs Thm, 


{5) 


1 1 I 4* I »• I 

^ o 


To find an expression for g m terms of k let ns snppose that a set of n 
TneasTtrements hu been made, and that eaidi nearotement is affected 
vith an error of some size In the case of any single measurement the 
probabilitj of an error of znagaitade s to is approzunaielr 

yAjoas (h/V*)« (Art 142) Henee the probable number of errors 
of this sise in the n measoremeats is n times thu pnhabihi^, or 
(tA/y/*)e •''’Af The $xm of these errors is therefore the number of 
errors times the size of a single error, or {tAa/'y/r)e^^&x The sum of 
all the errors of all sizes is therefore 


S= f r"-'d»=^ f '."■■lii 

- V«- Vw*'* 

=-I^C ■■‘•"I.' 


Hence 

( 6 ) 




136 Relations between the Precision Measures. From (2) and (4) 
of Art 155 we hare 


( 1 ) 


=5 0 6743fi = ^ roughly, 
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and 

( 2 ) 

Also, since 

we have 

(3) 

Hence 


M = 


0.G745 


= 1.4826r. 


i=vW 


^ ISi* -j- ‘ 


n 


= mV2 , 


, = i ^ = /X -x/i = 0.79788/1 
= 0.8/1, approximately. 


(4) 

a= = 1.2533n. 

^ 0.79788 ‘ 

Furthermore, 

from (2) and (4) we get 


1.4826r = 1.2533r;. 

(5) 

and 

. 1.2533 n O/t eo 

1.4826 = 

(6) 

1.4826 

“ 1.2533 “ 1-I829r. 


All these relations are shown concisely in the following table: 




r 

V 

- 1 

1.0000 

1.4826 

1.2533 

r= 1 

0.6745 

1.0000 

0.8453 

T) = 

0.7979 

1.1829 

1.0000 


157. Geometric Significance of ji, r, and »3. From the definition of r 
it follows that its corresponding ordinate to the probability curve bisects 
the area under that curve on either side of the y-axis. 

The quantity u is the abscissa of the point of inflection of the prob- 
ability curve, as we shall now show. 

Taking the second derivative of 



and equating it to zero, we have 
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The relative sizes of the precision measures and their geometric relations 
are shown in Fig. 45. 

The question naturally arises as to which precision measure is the 
best for jlractical use. On this point there is no universal agreement. 
In continental Europe the m.s.e. is used almost exclusively, but in 
England and America the p.e. is more often used. The average error 
is also used in America, but usually under the name average deviation. 

The M.S.E. is used almost exclusivel}" in Mathematical Statistics, where 
it is called the standard deviation and denoted by a. 

The average error is the easiest of all to compute, and the p.e. is the 
most laborious, because of the factor 0.6745. Nevertheless, in this book 
we shall conform to American practice and use the p.e. almost exclusively. 


158. Relation between Probable Error and Weight, and the Probable 
Error of the Arithmetic and Weighted Means. In Art. 148 we derived 
the relation between the precision index h and the weight w of an 
observation, namely: 


(168.1) 


IPl iV2 Wi 


Then in Art. 155 we found the relation 


hi. 

Wn 


r = ^ , where p = 0.4769. 

Hence 

= £ . 
r 

Let Wj, W 2 , - ■ ■ Wn be the weights of observations whose probable errors 
are rj,.r 2 , • • Th, respectively. Then 



Substituting these values for h,, h., • • • in (136. 1), we get 




2 2 
p . 

or 

ri'Wi 

r„^1Vn 


1 

1 1 

Hence 

r.*w, 

rj^w, ~ ~ r„^w„ 

(168. 2) 


— = ^, etc. 
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The iitxghts are thus tniersely proparlional to the squares of the prolalle 
errors 

Tilts relation (158 2) enables as to find the re of the arithmetic and 
weighted means of a set of n direct nica»ureineDts 
To find the re of the arithmetic mean of n direct measurements of 
equal weight let the weight of each measurement be 1 Then the weight 
of the mean of all the measurements will be n Denoting by r the pi 
of any single measurement and by r# the PE of the mean of all the 
iiiea»urenients we haie from (138 2) 


Hence the PE of the mean is 

(ISS 3) r, = — 

Vn 


If the measurements are not all of equal weight, let W|, tO;, la* 
denote their weights Then if r denote the pc of a measurement of 
«nif weight (ii)= 1 ) and u the pe of a •neasurement of weight tyo we 
have from (158 2) 


Heoco 


(158 4) r, = -^ 

Vie* 

Now the weight of the weighted mean is Sw = Wi + lo* H + Wn 
Hence bv (158 4) the VE of th» mean u 


(158 S) 


VW| + w» + 


Formula (158 3) shows that the pk of the arithmetic mean can be 
decreased by increasing the number of measurements A glance at the 
graph of this equation shows, however, (see Fig 46) that the decrease 
IS very slight after several measnrements have been made Usually it 
does not pay to mahe more than ten measurements for the purpose of 
reducing the P E of the arithmetic mean 


159 Computation of the Precision Measures from the Residuals. So 
far in our discussion of precision we have been considering the errors of 
measurements Since the true errors can not be found, it is necessary 
to derive formulas for the precision measures in terms of the residuals 
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Tn Art. 151 it was shown that when the errors of a set of measurements 
follow the Normal Law of error, the residuals likewise follow a similar 
law. The probability equation ^for any residual will therefore be of the 
form 


(1) 



ro 



for measurements of equal weight, where II — h.^/ n/{n — 1). (See Art. 
161.) For a set of n direct measurements of equal weight we therefore 
have for the n residuals the following probabilities: 

pi = p-, — • • ■ p„ — . 

Vir Vw Vir 

The chance that this particular set of residuals w’ill be made in any set 
of measurements is then 

(2) P = p,p2 ■ ■ •p„= • • ■ dvn . 

Differentiating (2) with respect to H and putting the derivative equal 
to zero, e.xactly as was done in Art. 155, we get 
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Hence 


or 

(3) 

Therefore 
(189 1) 
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1-1 ^ 

E~hy fi ’ 


^ Jn — 1 -/«— 1 

7V2 Av'2 > n > n 


= — ±ii.. 


i* 


— -J gt + 

' n — 1 


r = 0 6m)i =06145 



For the P B. of the arithmetic mean we hare 


(169 8) r. = 4= = 0 6-45 JSSL- 

’n(n— 1) 

If the measuremenU are not all of equal weight, the reaidnals wiU not 
have the same weight They can all be reduced to unit weight, howerer, 
by multiplying each of them by the square root of its weight Thia 
follows from (168 4), since PtVvi = r 
Let Vi, V( v. be the residuals of n measurements of weights 
Wi, wj, tPa Then the residaals reduced to unit weight are 


p'x = PiVwi, 
= g*VWi > 


g» = g«Vw» 

Sqaamig these equations and adding we get 

(6) 2®^ = 2wg* 

Xow for a set of measurements of equal weight we hare from (159 1) 

r = 0 6745 -y/.S^ 

"n — 1 

Beplacing St> * by its equal from (6), we get 
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(169.3) r = 0.6745 = 0.6745 + ' ■ • + 

' »n — 1 n — 1 

This is the p.e. of a single measurement of unit weight. 

To find the p.e. of a measurement of weight Wi and the p.e. of the 
weighted mean we have from (158.4), (158.5), and (159.3) 


(169.4) 
(169. 6) 


u = -4= = 0.6745 
y/v)i 


J , 

^ (n — l)ti>i 



0.6745 


’ (n — 1)2“^ 


It will be observed that (159. 5) reduces to (159. 2) when all the weights 
are equal. 

"We now collect for easy reference the fundamental formulas for com- 
puting the P.E. of direct measurements. 

(a) Measurements of equal precision, p.e. of a single measurement: 


(169.1) r = 0.6745 + • _ • . + . 

’ n — 1 

P.E. of arithmetic mean: 

(169. 2) ro = 0.6745 + + ’ ‘ ' + ^■'L . 

'' n(n — 1) 


(b) Weighted measurements, p.e. of a single measurement of unit 
weight: 

(169.3) r ^ n fi7As + • • • + 

^ n — 1 

P.E. of measurement of weight Wii 


(159. 4) 

P.E. of weighted mean: 


r, = 0.6745 + ' ' ' + 

^ (n — l)w{ 


WnVn- 


(169.5) - n R74K J + • • • 

(n — l)(w»i -f- -f- ■ * ■ -1- u)„) 

160. The Combination of Sets of Measurements when the P.E. ’s of 
the Sets are Given. When several separate determinations of the magni- 
tude of a quantity have been made by different observers or by different 
methods and the probable errors of the separate determinations are given, 
it is important to know just how to combine these several results so as 
to obtain from them the best value for the measured quantity and the 
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probable error of this best value For example, the results of five different 
determinations of the atomic weight of ailver are given below How can 
we obtain from them the best value for the atomic weight and how can 
we find the PE of this valued 

107 9401 ± 0 0058 
107 9406 0 0049 

107 9233:!;OOUO 
107 OSn ± 0 0045 
107 9270*0 0090 

This IS really a problem ir indirect measurements, but it can teadilv 
be sohed by the methods already given The proper method of procedure 
ID a problein of this type is first to compute by the lelaljon (158 2) the 
weights of the several determinations from their given probable errors 
and then find the weighted mean of the giicn values of the measured 
quantity The p E of this weighted mean is to be computed by formula 
(1S8 5) See Example 4 

IfoU Some authors compute the r i. of the weighted mean la this 
ease by finding the residuals of the sets bf measurements and then finding 
*he PE of the weighted mean by formula (159 5) Such a method u 
incorrect, and the p e of the weighted mean found by thia procedure 
may be worthless For an investtgation of this matter from several angles, 
ace the following papers 

1 “The Invalidity of a Commonly Used Method for Computing a 
Certain Probable Error” Proe Nat Acad Set. Vol 15, No 8 (August, 
1929), pp 665 669 

2 “ On the Computation of the Probable Error of a Weighted Mean” 
Am Math Monthly, Vol XIjII, No 5 (May, 1935) pp 286 301 

We shall now show the use of the formulaa derived in the preceding 
sections 

Example 1 The following m»asurements were made to determine the 
length of a base line m a geodetic survey Find the most probable 
length of the line, the r E of a single measurement, and the p E of the 
arithmetic mean 

Solution The measurements, residuals, etc aie arranged in tabular 
form as shown below The first step in the solution is to find the arith- 
metic mean of the given measurements Then the residuals are found 
by subtracting each measurement from the arithmetic mean 
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Mj. = 455.35 

Vi = — 0.02 

Vi^ = 0.0004 

M, — 455.35 

Vi — — 0.02 

Vi- = 0.0004 

Mi = 455.20 

Va = -|- 0.13 

Vi^ = 0.0169 

= 455.05 

u, = -f- 0.28 

Vt* = 0.0784 

Mi = 455.75 

t)a = — 0.42 

Vo- = 0.1764 

Mi = 455.40 

Ue=: — 0.07 

V = 0.0049 

M, = 455.10 

V, == -f 0.23 

Vr^ = 0.0529 

Mi = 455.30 

Vi 0.03 

Vb- = 0.0009 

Mo = 455.50 

Ug= — 0.17 

V = 0.0289 

3/,o = 455.30 

Vio = -f- 0.03 

Vio^ = 0.0009 

= 10 X 455 + 3.30 

= 0 

^v- = 0.3610 


Mo = 


10 X 455 + 3.30 


r = 0.6745 

^ 9 


= 455.330. 

= 0.135, by (159.1). 


ro=:^^ =0.043, bv (159.2). 

Vio 

The length of the line is therefore to be written 
M = 455.330 ± 0.043. 


Note. The number of significant figures to be recorded in the most 
probable value (arithmetic or general mean) is usually one more than 
the number given in the individual measurements (Art. 7). If the P.E. 
of the final result should be relatively large, however, we are not justified 
in recording this result to more figures than are contained in the separate 
measurements, and in such cases we record the final result to the same 
number of figures as given in the data. 

The P.E. of the result is recorded to only one or two significant figures — 
just enough to extend to the last figure of the mean. Slide-rule accuracy 
is therefore amply sufficient in the computation of probable errors. 

In finding the residuals we use only as many figures in the mean as are 
given in the individual measurements. 

Sometimes too much importance it attached to the probable error of a 
mean and too little to the mean itself. The mean is the important thing 
in any set of measurements or in any combination of sets; the probable 
error is of secondary importance. Theoretically, the weights of the separate 
means shpuld be used in computing the general mean, but in the com- 
bination of only a few sets of measurements — from two to five, for 
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example — such a procedure la of doubtful value When only a few sets 
are to be combined, the simple average js usually better than the weighted 
average and is much easier to compute 

ExampU 2 The following measurements were made to determine a 
certain wave length Find the most probable wave length and its pe 

Solulvin Here we first find the meau and then the residuals as before 
The rounded mean is correct to its last figure as given, but since the last 
digit 18 slightly less than 5 the mean when rounded to three decimals is 
4 505 From this number we subtract the individual measurements to 
find the residuals 


n 

if 

V 


1 

4 524 

— 0 019 

0000361 

2 

4 500 

+ 0 005 

0 000025 

3 

4 515 

— 0010 

0 000100 

4 

4 508 

— 0003 

0 000009 

6 

4 513 

— 0008 

OOOOOC4 

6 

4 511 

— 0006 

0 000036 

r 

4 49? 

+ 0008 

0 000064 

8 

4 60? 

— 0 002 

0 000004 

9 

4.501 

+ 0004 

0 000016 

20 

4 502 

+ 0003 

0 000009 

11 

4 485 

+ 0 020 

0000400 

12 

4 519 

— 0014 

0 000196 

13 

4.517 

— 0 012 

0 Q00144 

14 

4 504 

+ 0 001 

0 000001 

15 

4 493 

+ 0012 

0 000144 

16 

4 492 

+ 0 013 

0 000169 

17 

4 505 

0 000 

0 000000 


= 4 6055 

20 = — 0008 

2p* = 0 001742 


r, = 0 6745 •xf£®21Ii5 =0 0017, bv (159 2) 
17X16 ’ ' ' 

3f = 4 6055 ±. 0 0017 


Remari Theoretically the algebraic sum of the residuals should be 
zero, but since these residuals in any actual problem are necessarily rounded 
numbers their algebraic sum is rarely zero However, if the algebraic 
sum of the residuals is not practically zero, there is a numerical mistake 



Art. ICO] 


ILLUSTRATIVE EXAMPLES 


501 


either in the mean or in some residual. Hence it is very important to 
check the computation by noting whether Sv is practically zero. 

Example S. Six measurements of the parallax of a star are given in 
the following table. Find the most probable value of the parallax and 
its P.B. 


M 

w 

wAf 

V 

i’* 

wv^ 

O'. 507 

8 

4.056 

-0.104 

0.010816 

0.086528 

O'. 438 

5 

2.190 

-0.035 

0.001225 

0.006125 

O'. 381 

2 

0.762 

0.022 

0.000484 

0.000968 

O'. 371 

8 

2.968 

0.032 

0.001024 

0.008192 

O'. 350 

13 

4.550 

0.053 

0.002809 

0.036517 

O'. 402 

20 

8.040 

0.001 

0.000001 

0.000020 



^wAI 





Su) = 56 

= 22 566 



= 0.13835 


Mo = = 0".403. 


56 


To = 0.6745 

Hence the final result is 


V 


0.13835 


5 X 56 
M = 0".403 ± 0".015. 


= 0.015. 


Here the p.e. of the weighted mean is so large (relatively) that we are 
not justified in recording the result to more figures than are given in 
the data. 


Example 4- Seven separate determinations of the difference of longi- 
tude between two places gave the following results. Find the most 
probable value of the longitude difference and its p.e. 


1 

19'" 

1^42 ±: 0L044 

2 

19 

1 .37 ± 0 .037 

3 

19 

1 .38 ± 0 .036 

4 

19 

1 .45 rh 0 .036 

5 

19 

1 .60 ± 0 .046 

6 

19 

1 .55 ± 0 .045 

7 

19 

1 .57 ± 0 .047. 


Soluiion. The first step in the solution of this problem is to find the 
weights of the different determinations from their given probable errors. 
From Art. 158 we have 
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= f»*», = = r,*U)r = C 


Let us take the weight of the last determination as unity, that is, let 
U9 put 

Wt = 1 


Then c = r,»= (0 047)* 

Hence 



In. like manner we find 

w, s 1 70, ss 1 70, Wj ss: 1 04, ju* = 1 09 
To save labor in the computation of the weighted mean let us denote 
by di, d, d, the differences between the various determinations and 
an assumed approximate value of the weighted mean, say 19’^ 1' 40 Then 
the various determinations are 19'®l*40 + d„ ]9"l*40 + d„ etc , and 
their weighted mean is 

^ 40 ■[- d )a>i + (lO"!* 40 + d )tr, 4- + 40 4- d,)v, 


_ (»t>, + ti». + iP.XlO"-!* 40) + tc,d, + «>,d, • 

“ wi + w, + + 


=:19’"1M0- 


to,d, -j- tt d + + If rft 

+ w. 


This equation shows that it is ncccs'try to multiply only the d’s by 
the weights We therefore complete the solution by making out the table 
shown below and then using (158 5) 
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Mo = 19 “ 1».40 4 - = 19 “ 1*.40 + 0.061 = 19 “ 1 «. 461 . 

Then since the weight of Mj is assumed to be 1, we substitute the value 
of r, in the formula (158. 5) and get 


To = 


0.04Y 


= 0».015. 


V9-28 

M = 19™ 1».461 dr 0*.015. 


Note. The reader is reminded that the expression M = Ifo dr r does not 
mean that the true value of M is somewhere between Mo + r and Ifo — r; 
nor does it mean that M is probably in error by the amount r. It means 
that, so far as accidental errors are concerned, the true value of ilf is just 
as likely to lie between ilfo + r and Mo — r as it is to lie outside of these 
limits. 
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1. Ten measurements of equal precision were made to determine the 
density of a body, the results of the measurements being as follows : 9.662, 
9.673, 9.664, 9.659, 9.677, 9.662, 9.663, 9.680, 9.645, 9.654. Find the 
probable error of a single measurement, the most probable value of the 
density, and its p.e. 

2. Twelve measurements of an angle in a primary triangulation gave 
the following results. Find the p.e. of a single measurement, the most 
probable value of the angle, and its P.E. 


116 43' 44". 45 

50 .95 

49 .20 
47 .40 

51 .05 

50 .60 


116 43' 51" .75 
52 .35 
51 .05 
49 .05 
49 .25 
49 .25 


3. Ten measurements of the coefficients of expansion of dry air gave 
the following results. Find the most probable value of the coefficient and 
its P.E. 


3.643 X 10-® 
54 
44 
50 
53 


3.636 X 10'* 
51 
43 
43 
45 
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4. A certain coefficient of expansion vas measured with different 
apparatus with the following results Find the best ralne for the coefBcient 


and its p E 




Keasurement 

Weight 

Ifeasurement 

Weight 

0 0045 

3 

0 0036 

2 

0 0039 

2 

0 0026 

2 

0 0034 

5 

0 0027 

1 

0 0030 

4 

0 0043 

3 

6 An angle was measured several times with a transit and then sercral 

times with a theodolite. 

with the following results 


Theodolite 


36* 41' 28" 

’±11" 

Transit 


36* 41' 23 ' 

’8±2'7 


Find the most probable ralae of the angle and its tX. 

6 Six determinations of the relocity of light by different ebserrers 
at different times gave the following results, with their probable errors 

298000 ± 1000 
298500 ± 1000 
299930 100 

299990 ± 200 
300100 d; 1000 
2999U ± 50 

Find the most probable value obtainable from these determinations and 
its FE. 

7 Find the best value ot the atomic weight of silver and its p s from 
the following determinations 

107 9401 ± 0 0058 
107 940$ ± 0 0049 
107 9233 ±0 0140 
107 9371 ± 0 0045 
J07 9270 ±0 0090 

n IKOIRECf MEASUREMENTS 

161 The Probable Error of aoy Function of Independent Quantities 
Whose p E,’s are Known 
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represent any function of directly measured quantities 

Then errors Agi, Agz, • • • Ag„ in the g’s -will cause an error in the 

function Q, so that 

Q -f aQ = /(gi 4- Agi, gj + Aga,- • • gn + Ag»). 

Expanding the right-hand member by Taylor’s theorem and proceeding 
exactly as in Art. 6, we get 

(2) = A9i+ + - • •+ ^^3"' 

This expression for holds for any kind of errors whatever. If 

Agi, Aga, • • ■ Agn are accidental errors, so that they obey the Normal 
Law of error, then AQ is likewise an accidental error which obeys the 
Normal Law, as proved in Art. 144. In this case equation (2) is exactly 
like equation (2) of Art. 144, and all the results of that article apply to 
it. Hence if J?, Tii, hj, • • • h„ denote the precision indices of Qi, qi, 
gsj’ ■ ‘>qii, respectively, we have from (144.2) 



Let us denote the probable errors of Q, gi, qt, - ' ' g» by S, n, r*, • • -fn, 
respectively. Then from the relation p — hr found in Art. 156 we have 


S^'~ P^’ " p* Aa* P» ’ ' 


^ ^ , where p = 0.4769. 

ftn p 


Substituting these values of l/H*, l/hi*, etc. in (3) and reducing, we get 


( 161 . 1 ) 



This formula is of great importance, for it includes all possible cases 
of a function of directly measured quantities. It expresses th? law of 
the propagation of errors and is the foundation of the whole subject 
of indirect measurements. 

The terms relative error and percentage error may also be applied to 
probable errors. The fundamental formula for the relative error in indirect 
measurements is obtained by dividing (161.1) throughout by Q. We 
then have 

R_ 

Q~ 



( 161 . 2 ) 
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for the probable relative error The probable percentage error is 100 
times this 

iormula (161 2) assumes a very simple form when Q happens to 
be a product of several functions or a logarithm of a single function 
Suppose, for instance, that 

(1613) 0 = 

Then 

30 _§«, 30_0ii, 30 _ Op 

8x X y 3* * ' 

and when these are substituted in (161 2) ve get 

for the probable relative error of Q 

It IS worth while to notice here that the ?£ of the weighted mean 
of several sets of measurements whose ^B’s are given (Art 160) can 
be found by the methods of the present article, for the weighted mean 
may be written in the form 


which IS a linear function of the M’» Hence on substituting in (161 1) 
the partial derivatives 93/«/3Wi =s v>,/lw, dM,/dMt s= t£>,/2u>, etc , we get 


R= J -H* r 


‘ ( 2 ®)* 

But Since r* = c/w,, fi’ = c/Wj, etc , we have 


■ (Zwy 


^ ^(Sro)* »c,'^(2w)* Wi *** 1 


= ^ Vw* + Wj + + ». = 


VSw 

Now if we tahe Wj = 1 (* = 1, 2, »), we get Vc = U and therefore 


■ V2«’ 


which IS formula (158 5) 
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On putting = • • • = tCn 'R’e get- = rj = • 

Then (4) reduces to 


which is formula (168.3). 


R = 


Vn ’ 


■ = r„, by (158.2). 


162. The Two Fundamental Problems of Indirect Measurements. The 
two main problems of indirect measurements are the following: 

1. Given the p.e.’s of a number of directly measured quantities, to find 


the P.E. of any function ot these quantities. 

2. Given a prescribed p.e. of the function, to find the allowa1)le p.e.’s 
of the directly measured quantities. 

The first of these problems is solved by substituting the data directly 
into formula (161. 1) or (161. 2), according as the given p.e.’s are absolute 
or relative. 

The second problem is mathematically indeterminate when the number 
of directly observed quantities is greater than one. For a function of a 
single quantity, say 

we have by (139. 1) 


R = 



n, 


or fi 


R 


dx 


HOa). The Method of Equal Effects. If, on the other hand, $ is a 
function of several directly measured quantities, we obtain a definite 
solution by using the method of equal effects, as explained in Art. 10. 
This method assumes that all the components (directly measured inde- 
pendent quantities) contribute the same amount to the resultant error in 
Q. Under these conditions all the terms under the radical in (161.1) 
are equal to one another, so that 


Hence 

( 1 ) 




Vn^ r„ 
oq„ 


R 


R 


R 


ri =- 


To =• 


cq. 


vs|£ 


= ■ 


Vn: 


39 

9?n 


In some problems the p.e.’s of some of the components are so small 
in comparison with the others that we may neglect them entirely when 
applying the method of equal effects, thereby simplifying the problem. 
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Thus, if we wished to find the local time at any place on the earth’s 
surface, we could compute it from the formula 


cos t =r 


sin A 

cosLcosd 


— tan L tan d 


as soon as v,e knew the altitude (A) and declination (d) of a heavenly 
body and the latitude (Zi) of the place The declination can be found 
from the Nautical Almanac to a hundredth part of a second of arc, but 
the altitude and latitude have to be measured at the place where the local 
time IS wanted If these are measured with a sextant or an engineers’ 
transit, they can not be measured much closer than to the nearest minute 
of arc Hence the declination is known so much more accurately than 
the altitude and latitude can he measured that we may treat the declination 
as free from error, so that the error in t will he due entirely to the errors 
in A and L If, therefore »c de«ired the local time to the nearest 
second, we would treat t as a function of A and L alone, take n= 2, and 
find the allowable rs-’s of A and L by means of formulas (1) 

To find out whether the error in any particular component haa a 
negligible effect in producing an error in the function Q we apply the 
following criterion 

UOb) Cnltrton for KegltgMt Cffectt If any component q, has a 
negligible effect in causing an error id Q, then we must hare * 


( 2 ) 


where R is the stipulated F E of C If several componenta g,, q,, 
should each satisfy (2), they may all be neglected provided 


S- 




When applying the criteria (2) and (3) to any particular problem, 
we are supposed to know in advance the size of the p E.’s of the components 
we contemplate neglecting, as in the case of the declination d in the 
astronomical problem mentioned above If we know nothing concerning 
the size of the PE.’s whose effect we contemplate neglecting, then the 
best we can do is to apply the method of equal effects to the terms under 
t>ic rahica'i in ^nere'ny oDkaining 
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dqi 




3 V 

0?2 




n^/—^Q 
oymx — 
dgm 


VVe may therefore neglect the effect of m components qi, q^,' • • qm if 
each satisfies the condition 

R 

(4) , (k = 1,2,3,- ■ -m). 

3V»|£ 

dqk 

The proofs of criteria (2) and (3) are simple and easy, but they will 
not be given here.* 

We shall now apply the preceding formulas to some examples. 

Example 1. From the simple pendulum formula 




we get 


9 = ^=fil,T). 


If I — 100 cm. and T = 1 sec., find the error in g due to errors of 0.10 cm. 
in I and 0.0020 sec. in T, respectively. 

Solution. Differentiating g with respect to I and T separately, we have 

^ ^ 27r^Z 

m ~ ^ r®' ■ 

From this point onward we proceed in one of two ways, depending on 
the meaning of the errors in I and T. 

(a) If the errors in I and T are actual, definite errors of the magni- 
tudes given, then we compute the error in g by the formula 


Hence 


Ao = —At -j- ^AT. 
^ dl ^dT 


[See (6.1)] 


. TT" . ZtT i , ^ 

Ag=i —Al—-^AT 


= 9.8696(0.10 + 200 X 0.002) = 4.935 cm./sec.* = ^ say. 

Since we do not know the signs of AT and AZ, we disregard the negative 
• See Palmer’s Theory of Measurements, p. 151. 
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Sign on the right and take the arithmetic sum of the terms This gires 
the maximum numerical value of e^g 

{b} It the given values of I and T are tiie means of several measurements 
and their given errors are the rs*a of these arithmetic means, then we 
compute the pe of g bj formula (161 1) Bence we have 


* = + ^1’ W = 9 8«96 VO M + 0 16 

= 9 8696 X P 4123 = 4 068cm/sec* = 4 1, say 


To find the relative and percentage errors under the two suppositions 
(a) and (b), we have 


(a) 


Relative error 


Ag_Al gAr_ 01 . 2(0 008) 

' g ~ I r 100 1 
= 0 001 + 0 004 = 0 005 


Percentage error as 100(A^/j) — 100 X 0 005 = 05 per cent 
(b) Since we are here dealing with a product of several quantities, we 
use formula (161 4) Hence 


7 = V(f )'+ <(^)’= V (0001)' + 4 (0 008)" 

a; 0 00412 = 0 004, aay 

Percentage P e = 100(Ji/g) = 100 X 0 004 = tH percent 
Example S Two sides and the included angie of a triangle were 
measured with the following results 

0 = 252 52 ♦ 0 06 feet, 

6 = 330 01 ± 0 06 feet, 

C = 42*13'0(r ± 30" 


Find the area of the triangle and its pk. 
Solution The formula for the area is 


A = sin C 

Hence 

ZA bsinC SA _ _ g am C dA ab cos C 

da~ 2 ' 3b “ 2 ’ aC ■“ 2 


Since the errors given in this problem are the probable errors of the 
given measurements, we should use formula (161 1) The use bf that 
formula in this example, however, would call for a considerable amount 
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of numerical work. To avoid this we calculate the relative error by 
formula (161.2) and then get the p.e. from the relative error. Hence 
we have 


R 

A 




The error in G must be expressed in radians. Hence 

1 


AC = 30 X 


X 


180 3600 

Also, cot C = cot 42° 13' = 1.1022. 


= 0.0001454. 


I = + (3^) + X 


= 0.00035. 

The area is 

, 252.52 X 300.01 X sin 42°13' 

A — 


25452 sq. ft. 


R = 0.00035 XA = 0.00035 X 25452 = 8.9 = 9, say. 
The required result is therefore 

A = 25452 ± 9 sq ft. 


A 



Example S. The distance between two inaccessible points A and B is 
desired to ± 0.1 foot. The required distance can not be measured directly 
but must be calculated from the measurements of CA, OB, and LACB. 
If 0 , h, and 6 (see Fig. 47) are approximately equal to 200 ft., 150 ft., 
and 45°, respectively, find the allowable errors in these directly measured 
quantities. 
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Solution Here 
and 


e— Vtt’ + h' — iahtosB, 
^ = 01 


The best way to solve this problem la by the method of equal effects, and 
we therefore use formulas (1) Differentiating e with respect to a, b. 
and 6 in turn, we have 

Sc a — t cos g Sc b — a C08 Sc at sin $ 

Sa c ’ Sb c * is c 


But c= V40000 + 22500 — 30000y2 = 1417 
Sc 200 — 75VT 93 93 ... 

5; = — i4rT~" = i4r7 


Sc ISO — 100V2 
Sb “ 141 7 ■ 


141 7 “ 
21213 


and ns 3 

Then by (1) we have 


Vaa; 


■?£ V3 X 0 66 


i = 0 087 = 0 09 it 


_ 0 1732 _ 
■ 018 ' 


’ V3 X 149 7 4491 


= 0 000386 rad = 1'2 


The large allowable error in b is dne to the fact that b is nearly peipen 
dicular to c, so that a considerable change in the former has little effect 
on the latter 


Example i The modulus of elasticity of a beam of length I, breadth 
b, and depth d, supported at the ends and loaded at the center by a 
weight IF, 18 given by the formula 


E = 


WP 

4dbd* • 


where a is the deflection produced at the center If it is desirei^ to 
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measure i? to 1 per cent, and the error in IF may be neglected, compute 
the allowable errors in a, 5, d, and 1. 

Solution. The formula for E may be written 

E = ^WPa-^1)-^d-\ 

This is of the form (161.3), where Kz=W/\. Then since B/E = l% 
= 0.01, we have from (161.4) 

o.o,=v<f)v(^)v(^)+s(f7. 

Now using the method of equal effects, we have 

>/ 4 X 9 (y) = o-oi’ ^(t) = 

and 100^ = ^ = 0.167 per cent, 
to to 

4^~y= 0.01, or ^ = 0.005. 

100— = 0.5 per cent. 
a — 

Likewise, 

100^ = 0.5 per cent. 

100^ = ^ = 0.167 per cent. 
a o 

Hence if the percentage p.b. of E is to be 1 per cent, the percentage 
P.E.’s of a, h, d, I, must not exceed of one per cent, respectively. 

163. Rejection of Observations and Measurements. Occasionally some 
individual measurement may differ so widely from the others of the 
same set that we may suspect the discrepancy to be due to a mistake. 
In such a case it may be well to reject this measurement entirely. To 
decide what to do about it we apply the following rule : 

Find the mean of all the measurements {including the "wild"’ one) 
and find the residual for each. Compute the p.e of a single measurement 
by formula (159.1). Beject any measurement whose residual exceeds 5 
times the p.e. of a single measurement. 

This rule rests on the following considerations: 

• Suppose the chance of an error of magnitude a; is 1 in 1000. Then 
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its probsbihtjr u p = 1/1000 = 0001 The chscce that an error of this 
size will not occnr is therefore 1 — 0001 = 0 999 From the probabilitj 
table we find the corresponding hx to be 2 3S6 
Now from Art 155 we have 


from which 


Hence 


hr = <> = 0 4789, 
. 0 4769 


to two figures 


2,326 
0 4769 


r = 4.9r. 


The chance of making an enor aa great as fire i mes the 2 s of a single 
measurement is therefore less than one in a thousand. As error of euch 
a magnitude is therefore eo improbable that we maj safely neglect it 


EtampXt A quantity if was measured with the results girert below 
Should any of the measurements be rejected? 


if = 236, 251, 249, 252, 248, 254, 246, 257, 243, 274 
Solution The arerage of these measurements u 
if =251 

Hence the residuals are 


*1 = •^‘ 1 5, V] = 0, Uj = 2, = — 1 , Uj = -^ 3, o* = — 3, 

er = + 5, v,= — 6, r, = + 8, e,» = — 23 
The P B. of a single measurement u 

= 0 6745 ^ ^25 + < + 1+0 + 9 + 25 + 36 + 64 + 5^ 

= 0 6745 X 10 01 = 6 75 

Fire times this f n. is 33 75, and since all the residuale are less than 
this we retain all the measuremenb 


EXERCISES XVni 

1 The side b and the angles 3 and C of a plane triangle were measured 
with the following results 

5 = 106 ± 0 06 ft , B = 28*36' ±1', C = 120'’12' ± 1' 5 
Find the angle A, th* side a, and their p »,’a 
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2. Two sides a and b and the included angle (7 of a town lot were 
measured to be 

a = 104.86 ± 0.02 ft., 6 = 214.24 dr 0.03 ft., 

C — 47°13' rir 1'. 

Find the side c and its p.e. 

3. The index of refraction of a prism is given by the formula 

sin ^(o + D) 

Bin \a 

If 2? = 28°34' rir 0'.5 and a = 62°48' dr O'.Y, find n and its P.E. 

4. The current in a tangent galvanometer is given by the formula 

I — K tan G. 

Find J and its p.e. when K — 1.963 dr 0.002 and G — 35° dr 0°.l. 

5. The volume of a right circular cylinder is given by the formula 

V = 

4 

Find F and its p.e. when h = 116.85 dr 0.28 mm. and d — 82.54 d: 0.28 mm. 

0. The diameter of a polished steel rod was measured fen times with 
the following results: 

0.6003, 0.5002, 0.4999, 0.4998, 0.4999, 0.5003, 0.5001, 0.5004, 0.5001, 

0.4999. 

Find the cross-sectional area and its p.k 

7. Explain how you would decide in any given problem whether to 
use formula (6.1) or formula (161.1). What is the fundamental differ- 
ence between these two formulas? 
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164 lattoductioiu An empitical tormula oc empirical equation, la one 
whose form is inferred from the results of experiment or obserration and 
in which the constants are determined from experimental or obserrational 
data Thus, it is known that the speed of a ship Ysnes with the horse 
power according to the formula 

P = tt+6V' 

The constants to be determined in this formula are a and b, and for the 
purpose of determining them we should take sereral sets of readings of 
the speed and corresponding horse power These seta of simultaneous 
values of V and P would when substituted in the given formula, give 
teveral equations in the two unknowns o and b The next thing to he 
done would he to find the best values for a and b from the several 
equations For the solution of this part of the problem three methods 
are available the graphte method or method of selected points, the method 
of averagti and the method of Least Sqttares We shall now consider 
these methods in the order named and illustrate each bj several examples 

165 The Graphic Method, or Method of Selected Points This method 
can be used whenever the given formula can be plotted as a straight line 
either directly or after a suitable transformation The equation given 
above for example can be reduced to a straight line form by putting 
F* s= t, thereby reducing the equation to the form 

P = o + b«. 

which 18 linear in the variables t and P 

To apply the graphic method to this problem we plot on coordinate 
paper the corresponding values of t(= F’) and P The plotted points 
should lie nearly on a straight line We then draw a straight line which 
will be a good compromise for all the plotted points and pass as near 
as possible to each of them The slope of this bne will be the value of 
b and its P intercept will be a If the line happens to pass through two 
of the plotted points or through any other two points whose coordinates 
ate easily detenuined (pointe at the comera of equarcs, for instance), 
we can substitute their coordinates m the given equation and solve the 
516 
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two resulting equations for a and b, but the points so used should he as 
far apart as possible. The drawing of the best representative straight 
line is a matter of good judgment. 

This method will give fairly good results when finely divided coordinate 
paper is used, but in general it is not recommended except for obtaining 
approximate values of the constants or in cases where the results obtainable 
by the method are as accurate as the data used. 

Example 1. The electrical resistance of a copper wire varies with the 
temperature according to the equation 

R = a-\-bT. 

For the purpose of determining the constants a and b the measurements 
of temperature and corresponding resistance given in the following table 
were made. Find the values of a and b. 


r 

19.1 

25.0 

30.1 

36.0 

40.0 

45.1 

50.0 

R 

76.30 j 

77.80 

79.75 

80.80 

82.35 

83.90 

85.10 



Fio. 48 


Solution. Plotting these pairs of values on a large sheet of paper and 
drawing what seems to be a good compromise line (Fig. 48), we find-that 
this line passes through the points (21,77) and (64,89). Substituting 
in the given equation the coordinates of these points, we have 
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aT.2l6 = M 
o4-64& = 89 

43S = IS i = ^ = 0n90, 
and 

fl = 77—81 X 02790 = 71 14 
Hence the required relation betveen R and T u 
fi = 71 14 + 0 2790r 

To eee hov veil this formula fits the data in the table vc compote the 
residuals of the several measurements Writing 
v = 02790r+71 14 — Jf, 

we have 

V, = 0 2790 X 19 1 + M 14 — W 30 = 0 15 

r, = 0 2790 X 25 0 + 71 14 — 77 80 = 0 32 

t.ss — 021 

v«= 0 39 

V| = — 005 

v, = — 019 

v, = — 001 

2v = 040, 2v* = 036 

EzampU £ The data in the following table fit a lonaula of the type 


(1) Sf*af 

Find the values of a and n and thence the required formula 



Solution Taking the logarithm of each side of the given equation, 
we have 

(2) Iogy = log«4-«logi 

Putting 


we get 

where a' = log a 


y = logy, *' = 1(^*^ 
y = loga4-»u:' = a'-|- tuf, 
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This is the equation of a straight line in the ne'w variables a/ and y'. 
To plot this line the most conveniently ■we use logarithmic paper. 
Plotting the given points on such paper, we find that they lie almost 

Y 



exactly on a straight line (Fig. 49). Hence ■we substitute in (3) the 
coordinates of the first and last of the given points and get 

log 1.06 = log 0 4 - 

log 2.11 = log a + n log 80 ; 


n + log o = 0.0253, 
1.9031n + log 0 = 0.3243. 

0.9031n = 0.2990, 
or 


Also, 


n = 0.3311. 


log a = 0.0253 — n 

= 0.0253 — 0.3311 
= 9.6942 — 10. 

.'. 0 = 0.4945. 

The required formula is therefore 


y = 0.4945 

Example S. Find a formula of the form 

y = ite"* 
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vhich will fit the data m the table below 



Solutton Taking the common Ic^arithm of each side of the giren 
equation, we haTe 

(4) log y = log fc 4- m® log e =: log fc 4- (’»vlt>ge)®. 


or 

y' = logifc4' where y' = logy 

This IS the equation of a straight line in the Tanablea x and y' To plot 
it we use semilogarithmic paper Plotting the given values of x and y 
on semilogarithmic paper, we find that the points lie nearlj on a straight 
line (Fig 50} Drawing on a large sheet of paper what seems to be a 


Y 
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good representative line, we notice that it passes through the points (0.4, 
13) and (8.6,140). Substituting these values in (4), we have 

log 13 = log X: -f 0.43429m (0.4) = log Z; + 0.173rm, 
log 140 = log fc + 0.43429m (8.6) = log fe + 3.7349m. 

Solving these equations for m and h, we get 


m = 0.2898, 

h = 11 . 68 . 


The required equation is therefore 

y = 11.58e®"®®” 


'Note. In logarithmic coordinate paper the origin is the point (1,1). 
Hence the equations of the axes are a; = 1, y~l. Putting a; = 1 in the 
equation y = ax", we get y = a. Hence in the straight-line graph of the 
equation y = ax" on logarithmic paper the constant a is the y-intercept. 

To find a formula for the exponent n, let (si, yi) and (^ 2 ,^ 2 ) be any 
two pairs of corresponding values of x and y. Then from (2) 

log yj = log a -f n log , 
logyi = loga + «loggi- 

logys — logyi = n(loga :2 — loga:i), 
or 

^51 « - ^ogy^ — logyi 

log 12 — logXi ' 

The origin of coordinates in semilogarithmic paper is the point (0, 1). 
The equation of the y-axis is therefore a: = 0, and that of the a;-axis is 
y = !• Putting a: z= 0 in (3), we get y = h. Hence in the straight-line 
graph of the equation y = fee"* on semilogarithnuc paper the constant k 
is the y-intercept. 

To find a formula for the exponent m we substitute in (4) two pairs 
of corresponding values of x and y, obtaining the two equations 

log y- = log X: -f (m log e)a: 2 , 
log Vi = log fc + (^ log e)xi . 

log y- — log yi — [xi — ii)m log e, 
or 

m = !psy.-l0gy. ^ 2 3025 (l°g!(.-lossl.) 

(I 2 — a:,)logc 


( 6 ) 


X 2 — a;, 
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If the giveo pouifa are so plotted that the equations of the axes are 
not as stated above, the y intercept mil not be the value of the constant 
a or it For instance, in Example 2 ve plotted the point (10, 1 OS) on Ike 
y-axu This is really equiralent to making the substitution z=;10x', 
so that the given equation is transformed into the equivalent equation 

y = a(10x')- = «X10V 

Putting s' = 1, we get y = 0 X 10* = 0 4945 X 10* *”* = 1 06, and this 
13 the actual plotted value of the y intercept The student should have no 
difficulty in deciding whether or imt the y intercept of the plotted straight 
line gives the true value ol the coefficienta a and k in any given example 

166 The Method of Averages. The residuals of a senes of plotted 
points are the vertical distances of these points from the best representative 
curve Some of the residuals will be positive and others negative The 
method of averages assumes that the best representative curve is that for 
which the algebraic sum of the residoals is aero To find the unknown 
constants in an empirical formula by thia method we first substitute m 
the given formula the several pairs of observed or measured values of z 
and y We thus get as many residuals as there are pairs of observed 
values Then we divide the residuals, or residual equations, into as many 
groups as there are constants in the assumed formula Each group should 
contain as nearly as possible the same number of residnala. By placing 
the sum of the residuals in the first group equal to aero we get a amgle 
equation in the unknown constants Placing the snio of the residuals in 
the second group equal to zero, we get a second equation m the constants, 
and so on Since the sum of the residuals in each group is zero, the sum 
of all the residuals is necessarily zero On solvmg simultaneously the 
equations obtained from the several groups, we obtain the values of the 
unknown constants in the original formuta A few examples will make 
the method clear 

Example 1 The data in the following table will fit a formula of the 
type 


y = a -t' hx -f- a* 


87 5 S4 0 


292 2S3 


77 * 
270 


63 7 


235 


46 7 


197 


36 9 
181 


( 1 ) 

Find the formula. 
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Solution. Substituting in (1) the several pairs of corresponding values 
of X and y, we get 


I 

II 

III 


f = a + 87.56 + 7656c — 292 ' 
= o + 84.06 + 7056c — 283 

(V 3 = a + 77.86 + 6053c — 270 
|t), = a 4- 63.76 + 4058c — 235 

(Vi = a + 46.76 + 2181c — 197 
= a -1- 36.96 + 1362c — 181 


Eesidual 

equations. 


Dividing these equations into three groups (since there are three con- 
stants to be determined), as indicated by the braces at the left, adding 
the equations of each group, and placing the sums equal to zero, we get 
the three equations 

2a -f 171.56 -f 14712c = 575 ' 

2a -}- 141.56 4- 10111c = 505 - 
2a 4- 83.66 4- 3543c = 378 


Solving these three equations simultaneously for o, 6, and c, we get 


0 = 107.72, 6 =r 1.7960, c = 0.0035036. 


Hence the required formula is 

y = 107.72 4- 1.79601 -f 0.0035036i*. 

This method of averages requires no graph and can be applied to any 
formula which is linear (of the first degree) in the unknown constants 
or to any formula which is reducible to a form linear in the constants. 

Example 2. Solve Example 2, Art. 165, by the method of averages. 
Solution. Strictly speaking, the residuals are, by definition. 


Vi = axi" — j/i , V 2 = ax." — yz , etc. 

But if we divide these equations into groups, add, and attempt to solve 
the resulting equations for a and n, we get into trouble at once; for the 
unknown n occurs as an exponent in several terms of a sum. 

We can avoid this trouble without much loss in accuracy by proceeding 
as follows: Instead of equating to zero the sum of the residuals of the 
y’s, we equate to zero the sum of the residuals of the logarithms of the y’g. 
For any residual we have from (2) of Art. 165 

v' — log a n log X — log y. 
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Hence the geyeral residuals are 

{ v'l = log a + 1 OOOOit — 0 0253 
v't = log « + 1 3010»— 0 1239 
v\ = log a + 1 min— 0 1818 
i;', ^ loga -i- 1 6021ft — 0 2253 
fi/, = log a + 1 6990b — 0 2577 
ju'.z=loga+1 7782n— 02810 
“ W,=loga + 18451ft— 0 3032 
[i/, = log a + 1 9031ft — 0 3243 

In actual practice we do not write down these equations m this foitn> 
but in the form given below 


loga + 1 OOOOn = 0 0253 log a + 1 6990 b = 0 2577 

loga+ 1 3010 b = 0 1239 logo -J- 1 7782b = 0 2810 

logo 4- 1 4771n =r 0 1818 log a + 1 8451n = 0 3032 

loga + 1 602ln = 0 2253 log a + 1 9031n = 0 3243 

(2) 4 log a 4- 5 38Q2n ua 0 5563 (3) 4 toga + 7 2254n =: 1 1662 

Solving (2) and (3) simultaneously, we get 

n = 03305, loga = — 03055 = 9 6945— 10 a = 04949 
The required formula is therefore 

y = 0 4949g* *»*» 

Nott The method of averages is the shortest and easiest method for 
finding the constants in an empirical formula, but it must not be used 
blindly The residual equations can be grouped in several ways,* and 

* The number of possible grouping is given b; tbe following fonaulu 

a) Two froupe The number of different lo which p + 9 different things esn 
be divided into ttco groups of p things and q things respectivelj, la 
<p4-e)» 
p'ql 

S) TAree group* The number of different wafs in which p + g + r different 
things can be divided into thrte groups of p things, q things, and r things, reapec 

fp + e + r)' 

p'g'pl 

c) Four or more group* The number of wapa in which we can divide p+9-f r-f* 
different things into /our groups of p things q things, r things, and * things, 
reipeetiveip, is 


And so on for any other case Tor the proof of these formulas aee Wentworth’s 
Collep* Alepbrs, pp 263 264, or Whitworth's Choice and CAsfiee, pp 63 64 
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each different grouping •will give different values for the unkno'wn con- 
stantsj even though the algebraic sum of the residuals be zero in every 
case. The resulting formulas ■will thus be different, and some of them 
will fit the data much better than the others. 

There is no way to determine in advance just what grouping ■will give 
the best result. As a general rule the best formula is obtained by grouping 
the residual equations in consecutive order, as was done in Examples 1 
and 2. The following example will serve to clear up the matter of 
grouping. 

Exam-pie S. Find by the method of averages a formula of the type 

y = a + hi’ 

which will fit the following data: 


X 

5 

7 

9 

11 

12 

y 

290 

I 560 

j 1044 

1810 ! 

2300 


Solution. The residual equations are 

= 1256— 290 

t;2 = o-f 3436— 560 
i;s=:a+ 7296 — 1044 
V* = a + 13316 — 1810 
Ub = a + 17286 — 2300. 

The number of possible groupings of these equations is 5!/(3I2!) =10. 
The ten different groupings and the resulting formulas corresponding to 
them are given below. 

fvi 

■^ y = 130.87 + I.257O1’. 


V3 

Va Sv = 0.000010, = 64.065. 

.Vs 


2 . 



y = 128.86 + 1.2593i». 



= 0.000071, = 72.600. 
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y = m 68 + 1 25841* 

2ti = 0 00028, 21/* 66 668 

y:=168 91 + 122402* 

2u = —0 000017 2t>» = 2038 694 

y = 135 95 + 1 25102* 

2t»=— 0000004 2ti» = 132m 

ys=253 69 + 1 11272* 

2« = — 0 000001, S®* — 37626 648 

y=137 76 + 124892* 

2» = — 0 000002, 2b* = 187 328 

y = 123 95 + 1 26512* 

Sb = 0 0000001, 2e* = 177 705 
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y — 123.84 + 1.2652s*. 

[Vx 

= — 0.000002, = 181.389. 


[Vs 


K 


y ~ 142.23 + 1.2436s* 


Va 2» = — 0.000001. = 393.303. 

[v* 


The best formulas are those for which 2^® is least and are evidently 
1, 2, 3. The poorest are 4 and 6. 

The best formula obtainable is found by the method of Least Squares 
to be 

y = 130.71 + 1.2572s*, 


for which 2^ = — 0.0000016 and 2®* = 64.004. 

A carefully constructed graph, obtained by putting s* = « and plotting 
the straight line y = a 4- hu on a large sheet of finely squared paper, gave 

y = 125 + 1.33s*, 

for which 2i’ = 281.48, 2f® = 25460.154 This formula obtained from 
a good graph is far inferior to nine of the ten formulas obtained by the 
method of averages. 

When the number of residual equations is large enough to allow three 
or more to each group, the method of averages can be depended upon 
to give good results. If we have only a few sets of data (readings or 
measurements) and can not easily obtain more, we should always use the 
method of Least Squares. This method gives only one formula and that 
is always the best possible one. 

Every empirical formula, however obtained, should always be tested by 
computing the residuals and seeing whether they are within allowable 
limits. 


167. The Method of Least Squares. This method says that the best 
representative curve is that for which the sum of the squares of the 
residuals is a minimum. Since the squares of the residuals are positive 
quantities, the requirement that their sum shall be as small as possible 
ensures that the numerical values of the residuals will be small ; and this 
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means that m the case of a series of plotted points the best lepresentatiTe 
cuTTe mil pass as closely as possible to all the points Before applying 
this method to empirical formulas ve shall first derire a fundamental 
rule which reduces the method to a simple procedure 
For simplicity let us consider the formula 

( 1 ) y = a -f bi + 

and find the values of a, b, and e which will make the graph of (1) pass as 
near as possible to each of the n points 

or, stated otherwise, let us find an equation of the form (1) which will 
be satisfied as nearly as possible by each of the n pairs of observed values 
(z>, yi), {s:>iy>) The equation will not in general, be 

satisfied exactly by any of the n pairs Substituting in ( 1 ) each of the n 
pairs of values in turn, we get the following residual equations 

u, = o + bi, + exi* — y, , 

TO + + 

V. = <1 + + e*,* — y. 

The principle of least squares says that the best values of the unlmown 
constants a, h, and c are those which make the sum of the squares of the 
residuals a minimum, or 

2c’ = 0,* + W»* + + 

must be a minimum Hence 

2 (a + bi 4 - M* — y)* = (a + b*i 4- cxi* — yiV + (» + + «»* — yO* 

+ +(a + ^^» + CT.* — y.)’ = /(a,b,c) 

IS to be a minimom 

The condition that /(a, b, c) be a maximum or a minimum is that its 
partial derivatives with respect to a, b, and c shall each he zero Vfe 
therefore have 

^ = 2 (o 4- bxi 4- ex,* — y.) + 2(o + b*, 4- cr,» — y.) 4- =0, 

||• = 2(a + bi, 4-ci,’ — y,)r, 4- 2{a4-bx, J- cx,*— y,)ri4- =0, 

= 2 (0 4- bii 4- cXi* — y,)x,* 4- 2(0 4- bx, 4- cx,* — y,)f ,* 4- =0 
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Dividing through by 2, we get the following three normal equations : 

(a -}~ “i" cii" — yi) (a 02:2' — Vz) 

-p • • ■ “}- (tt "f* CX„~ T/n) — Oj 

a:i(a + bxi -f- csr — i/i) + a:,(a + ii, cx,^ — 1/2) 

4- ■ - - + x„(a + bx„ + cx„- — y„) = 0, 

®i*(« + bxi cxi~ — yi) 4 - 2:2‘(a 4" ^^2 + CX 2 * — y^ 

4- • • • 4- x„^(a 4- bx„ 4- cx„= — 1/„) = 0. 

It will be observed that these normal equations can be written down- 
immediately by applying the following 

Rule'. To find the first normal equation multiply the right-hand member 
of each residual equation by the coefficient of the first unJcnown in that 
member, add the products thus obtained, and equate their sum to zero; 
to get the second normal equation multiply the right-hand member of 
each residual equation by the coefficient of the second unhnotvn in that 
member, add the products so obtained, and place their sum equal to zero ; 
and so on for the remaining normal equations. 

The normal equations are solved by the ordinary methods of algebra 
for solving simultaneous equations of the first degree in two or more 
unknowns. When there are several equations and the coefficients contain 
several digits, solve by the methods of Arts. 96 or 102. 

The number of normal equations is always the same as the number of 
unknown constants to be determined, whereas the number of residual 
equations is equal to the number of observations. The number of observa- 
tions must always be greater than the number of undetermined constants 
if the method of least squares is to be of any benefit in the solution. 

The rule above is applicable to any formula which is linear in the 
constants or to any formula which can be reduced to a form linear in 
the constants. 

Example 1. Find the equation of the straight line which comes nearest 
to passing through the following points: 

0.5 1.0 1.5 2.0 2.5 

0.31 0.S2 1.29 1.85 2.51 

Solution. Let the equation of the line be 

y = a -f- bx. 

Substituting in this equation the several pairs of values of x and y, we 
get the following residual equations •, 


3.0 

3.02 


X 

y 
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v, = a + 05J — 031 
v, = a+ b — 082 
V, = 0 + 156 — 129 
r. = o+ 26 — 185 
t>, = fl + 2 56 — 251 
t, = a+ 36 — 302 


Besidual equations 


Adding the right hand members and equating their sum to zero, 
6a + 10 56 — 980 = 0 


} get 


llnltiplyipg the right hand member of the first residual equation by 0 5, 
the second by 1, the third by 1 5, etc , adding the products, and equating 
their sum to zero, we get 


10 5a + 22 756 — 21 945 = 0 


Hence the normal equations are 


6a + 10 56 = 9 80 ) 
10 5a + 22 756 = 21 945} 


Normal equations 


Solving these by determinants, we have 


I 9 80 10 5 I 

121 945 22 75 ( _ 222 950 — 230 422 7 472 . . 

“”1 6 105 I 13650—11025 *“ 26 25 “ 

[10 5 22 75 1 

16 9 801 

. _ 1 10 5 21 945 I _ 131 670 — 102 900 _ 28 770 _ 

“ 26 25 26 25 ~ 28 85 ”* 

= 1 10, say 

The required equation is therefore 


y = — 0285 + liar 

Computing the residuals by Bubstituliog the given points lu this formula, 
■we have 

v, = — 0045, v,= — 0005, v, = 0075, 

v« = 0065, r, = — 0045, v, = — 0005 

^i> = 0 04^ ■2 j«» = oou 
Example £ Find a formula of the form 


y = o + 6* + «* 
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which will fit the following data : 


X 

0 

0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

0.9 

y 

3.1950 

3.2299 

3.2532 

3.2611 

3.2516 

3.2282 

3.1807 

3.1266 

3.0594 

2.9759 


Solution. Substituting in the assumed formula the corresponding values 
of X and y as given in the table, we get 


= a + Ob -f Oc — 3.1950 
V 2 = a + 0.1b 0.01c — 3.2299 

Va = o + 0.2b + 0.04c — 3.2532 

u, = a 4- 0.3b + 0.09c — 3,2611 

v, = a + 0.4b + 0.16c — 3.2516 
Do = a + 0.5b + 0 25c — 3.2282 
^7 = 0 + 0.6b 4- 0.36c — 3.1807 
Vs = a + 0.7b + 0.49c — 3.1266 
Ub = a + 0.8b + 0.64c — 3.0594 
Vio = a + 0.9b + 0.81c — 2.9759 ^ 


Eesidual equations. 


Applying the rule of page 529 to these equations, we get 


10a + 4.5b + 2.85c = 31.7616 
4;5o -f 2.85b + 2.025c = 14.0896 
2.850 + 2.025b + 1.5333c = 8.82881 


> Normal equations. 


Solving these for a, b, c, we find 

0 = 3.1951, 
b = 0.44254, 
c — 0.76531. 

Hence the required equation is 

y — 3.1951 4- 0.442541 — 0.76531a:^ 

If we compute the residuals by substituting in this formula the values 
of X and y given in the table, we find 

= 0.0001, = 0.0000549. 

The following e.xample is given to illustrate how the solution of a' 
problem in a routine, perfunctory’ manner can lead to a worthless result. 
The first computation is the perfunctory one in which the work is' done 
>u a routine, careless manner. The second computation improves on the 
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first by preventing errors of computation jn the evaluation of the deter 
mmants The third computation prevents errors of computation from 
the very beginning 

Example S The indicated horse power, I, required to dnve a ship of 
displacement D tons at a ten knot epeed js given by the following data 
Find a formula of the form I = aD* which will fit the data 


D 


1720 


635 


2300 3200 

789 1000 


4100 

1164 


Solution We have 

I — aV 

log / = log a + n log 27 

The res duals are really 

Vi s= oTj* — Ii, Ot = — h> etc » 


but we save a great deal of labor and commit very little error by vnting 

{ v't = log a + n log Di — leg /» 

«% = log a 4* n — log f* 

etc, 

and making the sum of the equates of the v'^s a minimum 

(a) P«f/unctofy Computation Substituting m these equations the 
corresponding values of V and I we get 


u'»s=logo-{ 3236n~2816 
v', = log a + 3 362» — 2 897 
t/i = log a 4- 3 fi03n — 3 000 
ti'i = logo 4- 3 613n— 3 066 


Besidual equations 


Since these equations are tineor m the constants n and log a, we can 
apply the rule stated on page 529 Adding the right hand members and 
equating their sum to zero we find the first normal equation to be 


4loga4-13 716»=:ll 779 


Multiplying the right hand member of the first residual equation by 
3 236 the second by 3 362 etc, adding the products and equating their 
sum to zero we get 


13 716 log a 4- 47 lln = 40 445 
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for the second normal equation. Rounding off these numbers to four 
figures, we have 

47.11n + 13.72 log a = 

13.72n + 4 log 


; a = 40.44 ) 
;a = 11.78 \ 


Normal equations. 


Solving these equations by determinants, we have 



40.44 

11.78 

13.72 

4 

161.76 — 161.62 

_ 0.14 _ 


47.11 

13.72 

~ 188.44—188.24 

~ 0.20 


13.72 

4 




47.11 

40.44 




13.72 

11.78 

554.96 — 554.84 

0.12 


0.20 

“ 0.20 

~ 0.20 “ 



a = 3.981. 



0.700, 


0.600. 


The resulting formula is therefore 

I = 3.98D“-’°“. 

Computing the residuals by substituting the data in this formula, we get 
v» = — 77, Vs = — 108, Vs = — 131, V 4 = — 182. 


Hence 


2v== = 67,878. 


The formula which we have found is evidently so poor as to be worth- 
less; for the residuals are large, all of the same sign, and the sum of their 
squares is exceedingly large. 

The results would have been far worse if we had rounded off to four 
figures the products obtained in evaluating the determinants, for in that 
case we would have had 

— 161-8 — 161.6 _ ^ 

" “■ 188.4—188.2 “ 0.2 “ ^ 


loga = 


555.0 — 554.8 

0.2 


0.2 


r. 1 - 


a = 10. 

Hence the formula would have been 

I = lOD, 

which is totally worthless in this case. 



EMPIRICAL FORMULAS 


ICkap xvni 


5S4 

The pool result obtained aboee » dae pnmanly to the fact that in the 
process of solving the normal equations three of the most important 
significant figares dwappearei hy subtraction (see Art 7) , for n and log o 
vere determined from the simple fractions 0 14/0 20 and 0 12/0 20, 
respectively, in each of vshich the aecond figure m both Eumerator and 
denominator is doubtful This loss of significant figures did not seriously 
affect n but in the case of a the effect was disastrous The reason for 
the greater effect on a is this An error < in logjif will cause an error 
2 S026 Ni in the antilog (Art 7) 


(b) Improved Computation Treating the elements of the deter 
minanta as eiact numbers and retaining all the figures in the products, 
we have 


40 44 

13 72 

11 78 

4 

4711 

13 72 

|1372 

4 

|471l 

40 441 

1 13 72 

11 781 


16176— Ifil 6216 _ 01384 _ . 
188 44 — 168 2384 ” 0 2016 “ ° 


554 9558 — 554 8368 0 1190 

oHIi 


whence 


The resulting formula is Ihettfote 

/ = 3 893f?* •”* 
The residuals in this case are 


ri = 7l6, V, = — 188, e, = 7 87, v« = — 121 , and 
2t>* = 2631 

(c) Accurate i^olufton 


One way to get the required constants correct to four significant figures 
in. thiA exampbt ia */i aolTe the pmblAoa ana's is/l ca«\ a’i vvs.'pifjLKviKA 
to eight significant figures, to that »e shall have five left after the first 
three disappear by subtraction ^e therefore make a new computation, 
using 7 place logs The results are as follows 
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n 


161.773154 — 161.554945 _ 0.21821 
“188.43257 —188.10644 “0.32613 


0.6691 


554.89958 — 554.68739 _ 0.21219 
0.32613 “0.32613 


0.65063 


and 


0 . = 4.4733 = 4.473, say. 


Hence the final formula is 

/ = 4.473 

The residuals are found to be 

Vi = — 1.1, rs = 5.2, 2/3= — 9.4, 124 = 5.3; 

and therefore 

2t; = 0.0, = 144.7. 

Note. This example serves to bring out an important point which must 
be kept in mind when determining the constants in empirical formulas. 
The point is this: The data used in determining the constants should be 
treated as exact numbers, and the computer must be careful about rounding 
off and dropping seemingly superfluous digits at any stage of the com- 
putation. The final values of the constants should be given to as many 
significant figures as are given in the original data. 

When it happens that some of the most important significant figures 
disappear by substraction, as in the example above, the computation must 
be carried through with enough significant figures at all stages to give a 
reliable result. As a general rule it may be stated that if the constants 
are desired to m significant figures and if a preliminary calculation shows 
that the first p figures will disappear by subtraction, the calculation must be 
performed with ni p -j- 1 significant figures throughout from beginning 
to end. 

In the solution of systems of linear equations the occasional loss of the 
leading significant figures by subtraction cannot be prevented, but the 
harmful effect of such loss can be lessened by preventing subsequent errors 
of computation. 

Here it may be remarked that the above rather trivial example has also 
been worked by two other methods: (1) by moving the origin to a point 
near the middle of the interval and (2) by the general method of Art. 169. 
All three methods gave the same result to four significant figures. 

168. Weighted Residuals. It sometimes happens that the residuals are 
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not all of the same weight This is the case when we nse the residuals 
of a funcUon of y instead of those of y iteelf In Ei 2, Art 165, and 
£z 3, Art 167, for eiample, we fonnd it necessary to use the residuals 
of log y instead of those of y In these cases the residuals were no longer 
of equal weight, as we shall now show 
Using the notation of Art 161, let 


Then 


Q=nv> 






Substituting this in (161 1), we get 

R~ny)r, 

where r denotes the p E of y and R the p b. of /(y) Hence 

f = r(y) 

Since the same relations hold between residuals as between probable 
errors, we may write 

B V 


where v and V denote the residuals of y and f(y>, respectirelj Hence 

Denoting by v, and tP/ the weights of y and /(y), respectirely, we hare 
from (158 2) 

»£ __ 1 

VC's R' F» - [r(y)]« 


(163 1) 


»/ = 7 


■ (r(y>3' 

Now if /(y) =; logi, y s= 2f log, y, where If = 0 43429, we hare 

ny)=^ 


Hence from (168 1) 


'• - ' 


and if all the y’» are of equal we gh^ then w, = 1 and we hare 
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We shall next derive the fundamental rule for writing down the normal 
equations when the residuals have different weights. 

By Art. 148 the best result obtainable from measurements of unequal 
weight is that for which the sum of the weighted squares of the residuals 
is a minimum. Hence we must have 


= tUiUi® + tUjVa* + • * • + w’r.Vn* a minimum. 

In the case of the equation y = a -i- bx cx^ (Art. 145) we therefore have 


w, (a + bxi -f czi® — yi) ® + ti> 2 (a + bx^ -j- cx.^ — yiY + • • • a minimum. 

Calling this expression f(a, h, c), taking the partial derivatives with 
repect to a, b, c in turn, and equating each to zero, we have 


^ = Zwi(a bxi cx^- — yi) + 210.(0 + hxz + — ^2) + ‘ • ‘ = 0, 

Tif 

^ = 2w,a:i(o-}- 611 + — y,) -f 21022:2(0 + hi. + c®2- — 1/2) + • • * = 0, 

= ZwiXi^a + bxi + cii* — t/i) + 2t02i2®(a + bxz + CI 2 ® — ^ 2 ) + • • • = 0, 


Hence on dividing through by 2 we get 


Weighted 
normal 
equations. 

In the case of weighted residuals we can therefore write down the 
normal equations according to the following 

Rule: To get the fit si normal equation multiply the right-hand side 
of each residual equation by its weight and by the coeflBcient of the first 
unknown in that equation, add the products thus obtained, and equate 
their sum to zero; to find the second normal equation multiply the right- 
hand member of each residual equation by its weight and by the coefficient 
of the second unknown in that member, add the products, and equate 
their sum to zero; and so on for the others. 

We shall now work Ex. 3 of the preceding article by the method of 


u)i(a -f- Oil -}- cii^ — yi) -J- Wzia -f- 01. -f ci.‘ — ijz) 

+ ■ • ■ + w„{a -f bx„ cx„- — y„) = 0 
u>iXi{a -f- bxi -|- cii* — yi) WiX2(a 612 + <^2* — Vz) 
-f • • • -f WnX„(a + bx„ -|- CI„* t/n) = 0 

WiXi^{a -f- bxi cii* — y,) WiXs^ia + bx^ CI 2 * — yi) 
+ • • • + v}nXri%a + bxn -j- CI„* — y„) = 0 
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weights By (168 2) the weights of the residuals are /iVif*, /jV-W*, 
and /.’/A/’, but since the factor l/3f* will dinde out m the nonnal 
equations we do not write it down at all The solution given below should 
be self-eipanatory j 

I = log a 4* n ^ 


D 1720 


/ 655 

/» 429025 


2300 


789 


622521 


3200 

1000 

1000000 


4100 


1164 

1354896 


V, = logo + 3 2355284n — 2 8162413 
V, = logo + 3 3617278ft— 2 8970770 
V, = logs + 3 5051500n — 3 0000000 
v« s log a + 3 6127839n — 3 0659530 


U eights 
429025 ] 

622521 f Residual 
lOOOOOO I equations 
1354896 j 


Now applying the rule lot writing down the weighted normal equations, 
we find them to be 


11880965 2ft + 3406442 logo = 10165776 6 7 Weighted norms! 
41497013 In + U880965 2 logo a: 35495260 6 ) equations 
Solving these by determinants, we find 

ns 06671, os 4 546 
The requited formula is therefore 

/=4546Zy»««» 

The residuals ate found to be 


V, = — 0 3, V, = 5 8, w, = — 9 4 f>, =: 4 6 
2v = 0 9 = 145 1 

Here the values of and are slightly larger than m the unweighted 
previous solution but the tack of improvement i« not the fault of the 
weighting method It is due to the singular nature of the exam} le treated 
After applying this weighting method to several simple examples of different 
types and comparing the results with thoae obtained by ignoring differences 
in weight the author is of the opinion that ordinarily it is not worth 
while to bother about the weights of the residuals , but problems sometimes 
arise in which the weights must be considered * 


* For a striking exaniple of tbe effect of wcighbag in some problems see an un 
portent paper by C E Van Orstrand On tbe Empirical Representation of Certaie 
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Bemarh. Since the weights in the preceding example are approximately 
as the numbers 43, 62, 100, and 135, the student may wonder why it is 
not sufficient to multiply the residuals by these smaller numbers instead 
of by the actual weights 429025, 622521, etc. The answer is that if we 
■ did tliis the corresponding products would be true to only two or three 
significant figures and these would disappear in this problem by subtraction 
in solving the normal equations, so that the results found would be very 
uncertain. We can state as a general rule that the number of significant 
figures used in the weights must not be less than the number of significant 
figures which are to be retained throughout the computation, unless the 
exact values of the weights happen to contain fewer figures than the 
number retained throughout the computation. 

169. Non-Linear Formulas. — ^The General Case. Not all empirical 
formulas can be handled by the methods thus far considered. For example, 
the relation between the pressure p and temperature t of saturated steam 
can be expressed by a formula of the type 

p = a(10)*'*^/<'**), 

where a, h, c, are unknovm constants. These constants do not enter the 
formula linearly, and no transformation of the formula will give a linear 
relation among them. Consequently they can not be determined by the 
methods previously given. We are now going to develop a method which 
will apply to any type of formula, however complicated it may be. 

Let us, consider a formula involving two variables, x and y, and three 
undetermined constants, a, 6, c. Such a formula may be written in the 
symbolic form 

‘ (1) . y = f{x,a,i,c). 

f k 

,Let floi io, Co be approximate values of a, b, c, obtained from a graph 
or by any other means, 'and let a, p, y denote corrections which are to be 
applied to Oo, bo> Co, respectively, so that 

a = Oo + a, 

(2) J b = + p, 

c = Co y. 

Then 

(3) y' = /(a;,Oo, bo,Co) 

Rroduction Curves,” Journal of the Washington Academy of Sciences, Vol. 15 (1925), 

No. 2. 
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MO 

▼ill be • function whose graph spproximatea the graph (1) more 
leas closely The ralues of this approximating function conesponding 

*• be 

If we take (1) to be the best or most probable function and its grsph 
to be the best representatiTe cnrre, then the residuals will be 

= «,b,c) — y, 

ti. = /(*,.«,b,c) — y., 

where y„ yj, y, are the observed y’a corresponding to Xj, x, x, , 
respectirely Substituting in (S) the values of a, e as given by (2), 
we have for the first residual 

Vi S5 f(x„ 4, + «, 6# + P, c, + y) _ y, , 

or 

(6) Vi + yi = /(*!.«• + «. b* + /8. o» + y) 

Considering the right hand member of (6) u a function of a, b, e and 
expanding it by Taylor’s theorem for a function of several variables, we 
have 


(7) Oi 4- yi s= /(*!, Og. b., c«) 

+ terms involving higher powers and products of a, p, y, 
where {dfi/da), mesns 

(a../- 

a =:a« 

b =c. 

Then since y', = /(s„o,,b„ e»), (7> becomes 


S- 3 
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Vi 


Ut 




rj_ — y'j^ — yi, r2=:y'2 — yz, •••»■« — y'n- 


Then the resicluals become 


( 169 . 1 ) 



Eesidual 

equations. 


These equations are linear (of the first degree) in the corrections a, p, y, 
and -we may therefore deal with the problem from this point onward 
either by the method of averages or by the method of least squares. If we 
use the latter method, we write down the normal equations by the rule 
stated on page 629. 

The quantities ri, fa, • • 'Vn are the residuals for the approximation 
curve y' = /(a:, Uc, bo, Co), since they are the differences between the 
observed ordinates and the ordinates to this curve. 

We shall now apply this general method to two examples. 


Example 1. Find a formula of the form 


y = mx b 


which will fit the following data: 


X 1 

27 1 

33 1 

40 

55 

68 

y i 

109.9 

II2.0 

114.7 

120.1 

1 

125.0 


Solution. When these values are plotted on ordinary coordinate paper, 
the points are found to lie nearly on a straight line (Fig. 61). The line 
which seems (to the eye) to fit them best has a slope of 0.37 and a 
y-intercept of 99.7. Hence we take 

mo = 0.37, bo = 99.7. 

The approximation curve is therefore the line 

y' = 0.‘37a: + 99.7. 
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SubstitutiDg in this equation the observed values of x, vre get 

j/'i =: 0 37 X 27 + 99 7 = 109 
/, = 0 37 X 33 + 39 7 = 111 0, 
y', = n4r, y'. = 1200, y',= 1249 

Hence 

ri = 109 7 — 109 9= — 0 2, 
r, = ni9 — 112 0 = — 01, 
r, = 00, r«= — 01, r,= — 01 



, w ?/» _ _ !£« -. 3/s. 

06 ■" Oft “ ^ ~ ”■ 36 • 
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Substituting in (169.1) these values of the r’s and partial derivatives, 
we get 

»ir=27a + /3 — 0.2 ' 

Vj = 33a J3 — 0.1 
Ua = 40a -f )3 + 0.0 
V 4 = 55a + /?~0.1 
Vs “ 68a — 0.1 


Eesidual 

equations. 


We shall complete the problem by finding the best values of a and /9 by 
the method of least squares. Forming the normal equations according 
to the rule on page 529, we get 

11068a 223)3 — 21.0 ^ Normal 

223a + B/3 = 0.5 ( equations. 

Solving these for o and we find 


Hence 


a = — 0.0012, = 0.152. 

m = 0.37 — 0.0012 = 0.3688, 


J = 99.7 4- 0.15 = 99.85. 
The required formula is therefore 


_ y = 0.3688a; + 99.85. 

Example S. Find more accurate values for the constants o, i, c, in 
the formula 

p = o(10)®^/<®**f, 
given the approximate values 


Oo = 4.53, to = 7.45, Co = 234.7. 

Solution. Per the partial derivatives {dp/da)o, idp/dh)o, (3p/3c)o we 
.ve 

®).= (!■) = -(lO) • log, 10, 

ISO 

p'l = ao(lO) p'^ Oo(10)M,/(c,*t.)^ g^C. * 

id ’ 

— — Pi7 ^a = p't — p*, etc. 
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so that the corrected values of the constants are 

a = 4.53 - 0.09669 = 4.433 

5= 7.45 + 0.06001 = 7.510 

c = 234.7 + 1.43991 = 236.14 

The final equation is therefore 

p = 4.433(10) 7.51Ot/(236.14.^0 

170. Determination of the Constants when Both Variables are Sub- 
ject to Error. In Arts. 166-169 it was tacitly assumed that the given 
values of the independent variable were absolutely correct and free from 
all error; the values of the function alone were supposed to be subject 
to error. This assumption is legitimate in most cases, for it is usually 
possible and practicable to obtain the values of one variable more 
accurately than the other. 

If both variables are subject to errors of the same order of magnitude, 
the problem of finding the best values of the empirical constants is more 
complicated except in those cases in which the data can be plotted as a 
straight-line graph, either directly or after a suitable change of one or 
both variables. In the present article we shall treat only the simple case 
in which both variables are of equal weight. This is sufficient for most 
problems; for, as was seen in Art. 168, it is not often necessary to take 
account of differences in weight. 

Let us consider n pairs of values (ij, yO, (^ 2 , ya),' • * (^^n, yn), and 
let these be plotted as points on a straight-line graph. The line which 
best fits these points will evidently be that for which the sum of the 
squares of the perpendicular distances from the points to it is a minimum. 
The equation of any straight line may be written in the form 

(1) or -f- 6y -j- 1 = 0, 

this symmetrical form being used because both x and y are equally subject 
to error. The perpendicular distance from any point (x',p') to the line 

(1) is given by the formula 

(2) ^ _ gj" -f h/ + 1 

Va‘ -f 

The sum of the squares of the perpendicular distances from the points 
(®i»yi)j (® 2 >y 2 ), etc. to the line (1) is therefore 

(3) hy, + l)* 

+ (a ^2 + hya -f 1)* -f • • • -f (ax„ -f bpn -f 1)*]. 
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Since tbii is to be a minimam, tU partial deriTativea with respect to a 
and h most each be zero 

Taking the partial derivatire of (3) with respect to a, we hare 
^ = F(ax. + bp, + ly + (ax, + hy, + 1)* 

+ >+{ax^-\-bs, + iy] 

+ + 6 ?! + + Xtiaxt + 6 4 - 1 ) 

+ +*»(or, + 6y, + l)] 

Expanding the terms within the brackets, redncing to a common denomi 
nator, and collecting terms, we get 

+ — 2y*) — 2a6 2y — 

Likewise, by symmetry, 

<*> f=-(HrfriTp[«(«’-**)2.J+(«'-S’)& 

+ o*^(2y* — 2*’) — 8a6 23* — 

Uultiplying (4) by a, (5) by b, adding the resnlts, and simplifying, 
we get 

Bat since 0F/'3a n= 0 and ^F/bb = 0 for a minimum, (6) reduces to 
a2* + 52y + » = o, 

(170 1) 

which shows that equation (1) is satisfied by the ralaes 

•=(^)='- 

In other words, the best representalne tine always passu through the 
eenlroxi oj Oie given points 

Since dF/da and dF/db must be zero for a minimum, we hare from 
(4) and (5), respectirely, 
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(170.2) 6(6* — o*)2^y+ (b^ — a^)^~2ab:Ey 

+ ab^ (Se* — Sy*) — an = 0, 

(170.3) o(a* — 6^)2a:y + (a* — ^■)2y — 2a?i 2^ 

— 0*6(2^* — 2y=)— 6a = 0. 

Problems of the type treated in this article are to he solved by means 
of formulas (170.1) and (170.2) or (170.1) and (170.3), always using 
(170.1) first. We shall apply this method to Example 1 of Art. 107. 

Example. 


X 

1 

y 

xy 


J/’ 

0.5 

0.31 

0.155 

0.25 

0.0961 

1.0 

0.82 

0.820 

1.00 

0 . 6724 ' - 

1.5 

1.29 

1.935 

2.25 

1.6641 

2.0 

1.85 

3.700 

4.00 

3.4225 

2.5 

2.51 

6.275 

6.25 

6.3001 

3.0 

3.02 

9.060 

9.00 

9.1204 

Sums 10.5 

9.80 

21.945 

22.75 

21.2756 


To facilitate the computation, the several known quantities are arranged 
in tabular form as shown above. 

Since 

2® _ 10.5 _ 2y _ 9.80 _ 4.90 

n 6 ~ n “ 6 ~ 3 * 

we have by (170. 1) 

4 90 

1.75a + ^ 5 +.1 = 0, 
or 

_ 5.25g + 3 

~ 4.9 

Substituting this value of b in (170.3) and reducing, we get 

5.7187a» + 23.45480* + 6.165o = 0. 

Solving for o, we find 

0 = 0, —3.8191, —0.28227. 

The corresponding values of 6 are found from the equation 
5 = — (5.25a + 3)/4.9 to be 

6= — 0.61224, 3.4796, —0.30981. 
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Since the slope of the line (1) is — afh, it is ohrions thst the valnes 
a — — 38191, 6 = 34T96 ate the only ones which will fit the data of 
this example The required line is therefotc 

— 3 8191x 4- 3 479Sy + 1=0, 

3 819x — 3 480y=I, 
or 

y = — 02874 + 1 097g 

This last equation agrees closely with that found by the ordinary method 
mArt 145 

If we compute the sum of the aqoares of the perpendicular distances 
from the eereral points to this line, we find 

2<f»=:000618 

7or the line found in £z 1 , Art 167, we find 
2d* = 000619, 
the two results are thus practically identical 
Bernari The reader wiU obserre that the detensmation of the best 
representatire line by the method of the present article inrolrea but littltj 
if any, more labor than the ordinary method of Art 167 

171. Finding th« Best Type of Formula. There exists so general 
method for finding the best type of formula to fit any giten set of data. 
Probably the best one can do is to proceed as follows 

1 Plot the data on rectangular coordinate paper, taJnng care to choose 
the proper scales along the two axes so as to make the graph show up to 
the best adrautage 

2 If the graph la a straight line, or nearly so, assume a formula of 
the type 

y = 0 + br 

9 If the graph is not a straight line but is a fairly smooth curve 
without sharp turns or bends, it la likely that the data can he fitted by 
some one of the following formulas 

RemarJcs and Suggestions 

(a) y = a + br + cr’ + dr* Linear in the constants 

b 

(h) y — ®+j Linear in constants Putl/x=< 

to plot. 
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RemarJcs and Suggestions. 


(C) 

1 1 IT. 

y = r-r- , OT — =a-\-hX. 

^ a+hx y 

Put 1/y = u and plot the straight 


line u = a hx. 

(d) 

y* = 0 bx cx® dx®. 

Linear in constants. 

(e) 

y = ah”, 

or log y = log 0 X log b. 

(f) 

II 

or log y = log o + bx log e. 

(g) 

log y = 0 . -1- bx -f- cx\ 

Linear in constants. 

(h) 

X 

^ 0 -j- bx cx® ’ 


or 

— = a -f- bx -}- cx®. 

y 

Linear in constants. 

(i) 

y = ax”. 

or log y = log a -f- « log 

(3) 

y = ax” -j- b. 

Use general method of Art. 169. 

(k) 

y = ae*'® -f- c. 

« Cf ft <t te t( 

(1) 

y = — r-v— -f C. 
a-\-hx 

tc <C It It 11 It 

(m) 

y = ae®® -f- ce"^. 

It It It It It It 

(n) 

y = ox" + hx”. 

<1 It It It It It 


4. As aids in determining which of the formulas (a)-(n) to use in any 
given problem, the following suggestions are offered: 

(a) If the observed data give a straight-line graph when plotted on 
logarithmic paper, use the formula 

y — ax”. 

(b) If the data give a straight line when plotted on semilogarithmic 
paper, the proper formula is 

y = oe®=, or y = ah”, 

(c) If the points (1/x, y) or {x, 1/y) lie on a straight line when plotted 
on ordinary coordinate paper, the proper formula is y = a -\- h/x in the 
first case and y = l/(a hx) or 1/y — a-\-hx in the second case. 

6. The polynomial formula 

y = o bx cx* dx* • -j- qx” 

can be used to fit any set of data by taking a sufficient number of terms. 
The requisite number of terms is given by the following 
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Theorem If the values of z art in artlhmetie progressvin (egutiufanO 
and the nth differences of y’a are eonslantj the Iasi term tn the required 
polynomial is x" 

Thia theorem la etmplj a co’oUaiy of the theorem proved in Art 19 

For example, the third differences m the following data are nearlj 
constant, 80 the required polynomial is 

y = a 6* + «* + d*** 


• 

V 


All! 

Aijr 

0 

0 




0 1 

0 212 

0 212 



0 2 

0 463 

0 251 

0 039 


0 3 

0 772 

0 309 

0 058 

0 019 

0 4 

1 153 

0 381 

0 072 

0 014 

5 

I 635 

0 472 

0 091 

0 019 

6 

3 207 

0 SS2 

0 110 

0 019 

7 

2 917 

0 710 

0 128 

0 018 

0 8 

3 776 

0 859 

0 149 

0 021 

0 9 

4 793 

1 022 

0 163 

0 014 

0 

6 001 

t 203 

0 181 

0 018 


This theorem applies only vhen the z's are taken at r;uat intmiab 
apart It rarely pays to take more than three or four terms m a poly* 
nomial formula, on account of the labor inrolied in determining the 
constants 

172. Smoothing of Obserrational and Expenmentel Bata. Some 
times it may be inconvenient or practically impossible to obtain an 
empirical formula to represent a set of observations or measurements In 
such cases the observations or measurements should be plotted on squared 
coordinate paper as usual Then if it is known that the function under 
consideration is continuous, or if the plotted points seem to follow some 
law, a smooth curve should be drawn which will be a good compromise 
for all the points but not necessarily passing through any of them 
Ordinates to this curve can then be measured at any point on the hori- 
zontal axis 

If the observations or measurements have been made for e^idtsianl 
vslnes of the independent vartahle, a better graph can he obtained by 
first correcting or smoolhiny the observations before plotting them Prob- 
ably the simplest and easiest method of smoothing is that due to Carl 
Bunge and will now be explained 
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Case I. Straight-line graphs and graphs with small curvature. When 
the plotted points seem to lie approximately on a straight line or on a 
curve of such small curvature that any three consecutive points lie approxi- 
mately on a straight line, we correct the ordinate of the middle point of 
the three by replacing the graph of the function over the interval avi to 
by a straight line. 

Let y denote the ordinate to the approximating line, let h = Xi — Xi-i 
= xui — X{, and let « be a new variable with origin at Xi such that 


( 1 ) 


u 



Then u = — 1, 0, 1 when x = ij-,, X{, Xui. 

The equation of the approximating line may be written 

(2) y = ao-{- Oi«. 

The residuals for the line are then y — p or ao-j-fliU — y, and in order 
that the line fit the data as closely as possible in the interval Xn to Xm 
the sum of the squares of the residuals in this interval must be a minimum. 


Hence 

2 (oo4-0i«— y)® 

-I 

is to be a minimum. Then by Art. 167 we have 

0 ^ 1 

5^2 (ao + ai«— y)* = 22 (flo + Ojtt— y) =0 

0 * » 

^ 2 (flo + flitt— y)* = 22 (Oo + Oitt — y)tt = 0. 

Prom the first of the above equations we get 


®o — fli — yt-i + — y< + <*0 ”l“Oi — yux — 0, 

from which 

y<-i + y< + yt*i 

“o — 5 , 


(3) 

o 

The corrected ordinate at x< is thus the mean of the ordinate at Xi and 
the two adjacent ordinates. Since we are interested only in we make 
no use of the second of the above minimum equations. 
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On adding and subtracting yt >n tbe nght hand member cf (3), ve get 


or 


S«=Sfi4- 


yt-.— gyt + y«4i 

3 ’ 


(4) ». = y. + ^, by Art. 16 

This equation is more conrenient for use than (3) 

Cose II Graphs mlk targe attralure When the currature of the 
graph 13 so laige that the graph cannot be approximated b; a straight 
line in a giren mterral, we replace the graph bj a vertical parabola passing 
through five consecutive points whose abscissas are rt-i, iw> Zbu 
Using a new variable u with origin at ft as in Case I, we may write the 
equation of the parabola in the form 

y — OtU* 

Then ti =— 2,— 1,0, 1,2 when * = f ar,.,, 

The residuals are + y, and in order that the parabola 

fit the data as closely u possible, 

t 

+ y)* 


must be a minimum Equating to lero the partial denratives of this with 
respect to a,, At, Oi, we get 

2 («• + «i« + «.«*— y) ssO 

2 (o. + «!« +«»«*— y)tt = 0 

2 («. + at« + o,«* — y) u* s= 0, 


5<»* + «i2«+«.2«' = 2y 
«*2“+«i2«*+a»2«*=2«y 
fl*2«*+«i2«*+«»i2w*=2«*y 
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> a 2 2 

Since 2«* = 10, = and 2« = 0, 2«* = 0, the above equations 

" -2 -2 -* 

reduce to 

6ao + lOfl? = yi-2 + yt-i + + J/ui + Vm 

1 Ofli = — — jj-i + yu\ 2yi+2 

lOao + 3402 = 4yt_2 + yi-i + yt*i "h 4yt+2' 

Since we are iuterested only in ao, we eliminate Oj between the first and 
third of these equations and thereby obtain 

— 3yi-2 ~f~ 12y<-i -f- 17yi -j- 12y«»t Syut 
Oo— 35 

Now adding and subtracting j/< in the right-hand member, we get 

3 

ao.= yi—^ iyi-2 — + ^i—^yui + yt+a) 

3 

= yi—^A*yt- 2 , by Art. 16. 


Hence we have 

3 

(6) yi = yi— 

as the corrected ordinate at the point xj. 

Formulas (4) and (5) are the smoothing formulas for the two cases 
considered. They may be applied as many times as necessary, or until 
the corrections become negligible in comparison with the y’s. 

It is to be noted that (4) will not correct the first and last observations 
of a set and that (5) will not correct the first two and last two observations. 

Extensive tables of smoothing formulas of the type herein considered 
can be found in Whittaker and Robinson’s Calculus of Observations, pp. 
295-296 (1924 edition). 


Example 1. When the following data are plotted on squared paper, 
the plotted points are seen to lie approximately on a curve of small 
cun'ature. Hence the y’s can be smoothed by formula (4), Two applica- 
tions of the formula are made for purposes of illustration, the results of 
the first and second corrections being denoted by y'e and y"e, respectively. 

It will be seen from the above table that the corrections are much 
smaller in the second application of the smoothing formula. This is 
generally the case. 



ExampU £ When the following observations are plotted on squared 
paper, the; are seen to lie approximate!; on a curve of considerable curva 
ture Hence we smooth them b; formula (6) We make two apnlications 
of the formula, as before 

The corrections m this case are seen to be much smaller in the second 
application of the smoothing formula 
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EXERCISES XIZ 

1 Find by the method of &magee a formula of the form 
which will fit the following data 

X \ 280 I 29S I 3X2 | 330 | 355 | 370 | 

y I 32 3 I 376 I «9 I 633 I 67 2 I 761 I 

2 Plot on logarithmic paper the data of the above eiample and find 
a and n graphically or from aetected pointa 

3 Find by the method of least squares a formula of the form 
y = a + bz* which will fit the following data 

a I 20 I 24 I 29 I 36 I 43 I 

y I 2100 I 2980 1 4310 ) 6600 j 9366~| 

4. The data in the following table can be fitted by a formula of the 
type y = ax* Find the formula by the method of averages 


65 1 

26 1 

1 14 1 

1 ’ 

1 4 

i ® 

1 0 1 

67 1 

156 1 

1 28 9 1 

1 604 

1 110 1 

1 149 

1 230 1 


5 The data given below can be fitted by an exponential formala of the 
type y = ae^* Plot the data on seroiloganthmic paper and find valnea 
for a and h 


z 1 

1 26 1 

1 50 1 

1 75 1 

1 100 1 

12 6 1 

1 ISO 1 

y 1 

1 76 1 

62 

1 36 1 

24 1 

16 I 

11 1 


6 Solve the preceding example by the method of averages 


7 Find by the method of least squares a formula of the type 
y = a bz' which will fit the following data 

X \ 81 I 12 0 { 16 2 I 22^ I 33 0 1 414 i 

y I 020 1 0 44~ I 079 j I S3 | 3 30 | 6 20 j 

6 The data in the table below can be fitted by a formula of the fype 

z/yrra + bz Find the formula by the method of averages 

9 Work the preceding example by plotting the pomts (z,®/y) on 
ordinary coordinate paper and finding the values of a and b 

Bxnt Put z/y = 11 Then the equation becomes u = a + bz, the graph 
of which IS a straight line 

10 In Exercise 3 put z* = f and plot the equation y:::a*|*bf Find 
from the graph the approximate values of a and b and then find corrections 
to these values by the general method of Art 169 
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11. Find by the method of averages a polynomial formula which will 
fit the data in the following table : 

a: 1 1.5 I 3.0 | 4.6 | 6.0 | 7.6 | 9.0 1 10.6 | 12.0 | 13.5 | 15.0 | 
y j 14 1 18 1 26 1 42 1 69 1 112 1 174 j 259 j 370 j 612 [ 


12. The data in the table below are to be fitted by a formula having 
y = 20 as an asymptote. Find the formula by any method. 


X 

0 ] 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

y 

84.9 

79.9 

75.0 

70.7 

67.2 

64.3 

61.9 

59.9 

57.6 

55.6 

53.4 


13. The table below gives the atmospheric refraction for a star, at 
various altitudes above the horizon. Assume that = + tan/i), 

omit the first and last values in the table, and find a and b by the method 
of least squares. 


D 

0° 

2“ 

4* 

6' 

8" 

10’ 

20’ 

O 

O 

60’ 

9b’ 

R 

34'60' 

18'06' 

11'37' 

8'23' 

6'29' 

S'lO' 

2'37' 

1'09' 

0'33' 

0 


14. The following points lie approximately on a straight line. Smooth 
the y’s by two applications of formula (4) and draw the line. 


Z 

1 1 

3 

3 

4 

5 

6 

7 

8 

S 

10 

11 

13 

13 

14 

16 

16 

17 

18 

10 

30 

V 

1.8 

2.6 

3 .S 

3.8 

4.3 

6.1 

6.5 

6.5 

6.8 

7.6 

8.1 

8.6 

0.6 

0.8 

10.6 

11.1 

11.7 

13.6 

13.0 

13.7 


15. Smooth the y’s in the following set by three applications of formula 

( 6 ) : 


X 

1 

3 

3 

4 

6 

6 

7 

8 

0 

10 

11 

13 

13 

14 

15 

16 

17 

V 

13.6 

11.0 

0.6 

8.0 

8.5 

8.3 

8.6 

8.0 

0.1 

0.4 

0.6 

0.0 

0.3 

0.1 

8.6 

7.6 

6.7 














































CHAPTER XIX 


HARMONIC ANALYSIS OF EMPIRICAL FUNCTIONS 
173 lotroduction \n\ penodic fanttion can be represented bv s 
trignonometnc seriea of the form 

(1) y = aa -f a, cos z + + +fl«co«nz 

b, sin z 4* 2x 4* ^ 

This function is periodic and has the period Sir A periodic function 
having a period different from 2» can be reduced to the form (1) by a 
suitable change of the independent vanahk ( \rt 176) 

l\hen ve wish to find an empirical formula to represent a phenomenon 
that IS known to be periodic — such for example, as the tides, alternating 
currents and voltages mean monthlj temperatures, etc — , we should always 
assume a formula of the typo (1) If the valnes of the function are 
known for certain equidistant Taloea of the independent vanablo^from 
readings of an instrument, measurements of a graph, or otherwise — , it u 
an easy matter to find the unknown constant* o»,o„ a*, b|,bt, b. 

In the present chapter we shall give explicit formolaa for computing these 
coefficients when the number of equally spaced ordinates is either 12 or 24 
We ahall also give schemes for reducing the numerical work to a minimum 
171. Case of 12 Ordinates We assume that the period of the unknown 
function IS Sir and that the value of (he function is known for 18 equi 
distant values of the independent variable The appropriate formula is 
then 

(174 1) y = a« + a, cos z 4- <>> cos 2z + Si cos 3z -\-BtCOtix 
4- Cl cos 5z 4- u« cos 6z 4- b, sin z 4- bi sin 2z 
4- bi sin 3z 4- am 4z 4- bi am 5z 

Xjet the corresponding values of x and jp be as given in the table below 


* 0* 30* 


V IP> y> 



ISC' I 





Then on substituting in (174 1) each of these corresponding sets of 
values we obtain the following eondituituU eqvaUons 

»i8 



CASE OF 12 ORDINATES 


55!) 


Art. 174] 

yi = ao+ ^ai+-|a2 + 0-a3 — -|a4— -^as — as+ 2^^ + ^^= 

+ + "^^4 + "2^/ » 

.1 1 1.1.. , V3^ 

y2 = ao + '2®i gfla — ®3 — -2^4 + -gfli + fle H jpOi + g Oj 

. n 7 . VS,. VIt. 

-f- 0 • Og —bt 2”°“ ’ 

yg — flo ”f~ 0 • fflj — O 2 "f" 0 ‘ ®3 “f~ ®4 “f“ 0 ■ flg — flg ”1“ "1“ 0 ’ ^2 

— 63 4" 0 ■ ^4 4" ^5 j 

11 , 11,, V3, 

Vi flo gOl 2^2 + ®3 •gfl4 2 ®* "T ®0 I 2 

^Og + 0 • Og + — ~2~^^ ’ 


V3 , 1 . „ 1 , V3 ,1, 

ye — flo *2^^ + ^ * — *2^4 H + ~2^i 

_ 4- 6g — -^64 4- "I^B , 

y^j flo — (ij -}- — fls " 1 “ Ct* ■ — “f* flc “}* 0 * &i -|- 0 ’ 62 

0 * 63 0 ■ 64 -}- 0 ' &5 j 

y, = Co — ^Oi 4- ^02 4- 0 • <13 — -|c4 4- ■^“5 — Og — -|bi 

7 . _L V'S , 1 , 

— 1 1 , 1 1 I Vs", 

yg — Co 2®i 2®- 4“ ®3 g®‘ 2 4" ®« 2~^*' 


4“ 4“ 0 ■ ^*8 ■ 


V3, V3, 

" 2-^4 4- -^6g, 


yo — Qo 4 " 0 ■ — fls 4 “ 0 • 03 4 " 04 4 ” 0 • Cg — flg — 61 4 " 0 • &2 

4* ^3 4" 0 ' ^4 — &o j 


Si. — 0 , + -lo, — -lo: — 0 , — io, + lo. 4- 0, — ^6, ~ 
+ 0-5. + ^j, + :!^j.. 



660 HARMONIC ANALYSIS OP EMPIRICAL FUNCTIONS (Chap XIX 

y.i = ». + -^0. + + 0 o. — «< — -1*1 — 


To boIto these equations fo' the a's and b’s ve applj the rule of Art. 
167 for writing down normal equations Thus, to find a« we multiply 
each equation by the coefficient of oa in that equation and add the results 
We then get 


12a, = y, + y» + yj + yi + y« + + y* + yt + yi + yp + yi» + yn » 


which gises a, explicitly in terms of the known quantities y,, jii, • ju • 
To find Oi we multiply each equation by the coefficient of Ot m that 
equation and add the results Thia gives * 


ContiauiQg in this manner, we get the following equations for finding 
the remaining o’s and 6 ’s 


* The rcMOD for the dueppeertece of all the «'« sad h's except ooe in the aorasl 
equstloss U t* follows 

Since the Bultipliers used In obUiaing the Bonnal equktioas are tines tad cosines, 
the eoefficIcBt* of the o’s tod ('• in the resulting normtl cquttioos tre til of sonie 
one of the forms 

XsInpWf, 21«>s«»„ ^tinps, ^iinp»,cosff*„ ^ cos po, eoi 

2^eos*»»f, 

where r ttkes the values 0,1,2, (at — 1), tnd m is the number of equidistant 
ordinates But 

2 tin p», = 0, cos f», = 0, 2 im p», cos qt, = 0. 

^ sin pa, sin qw, rs 0*1 

S. V >I P ^ d, 

T COS pn, cos 0 J 

sin* px, = 5, cot* 9x, = 2 

Since onij one of the a s or b'l in etch nomul equation has a coefBcient of the form 
sin* px, or ^ cos' qx„ it Is evident that all bat one must disappear 

For a simple and elegant proof of the relntioaa given above, the reader Is referred 
to Runge and KCnig's NumrrucAef PecAtieis page 212 
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602 = t/o + j/i — -|y2 — j/3 — \y* + \yi + y® + \y^ ~ ■fi'* ■” s'* 

1 , 1 
gl/io + > 

Goa 2= j/o — y2 y* — ye “I* 2/8 — yio > 


604 = yo — -^yi — •|y2 + ye — -lye — -lye + ye — ^yr — |y8 


+ y» — gi/io — -gyn , 


• 605 = yo- 


V3 


1 1 V3 , V3 1 

yi + 4 s' 2 — •^y«+ -Vys — ye + -yJ/T— ^ye 


, 1 V3 

+ -gyio ^S/n 


i2a« = yo — yi + ye — ye + ye — ye + ye — y? + y8 — y» + yio — yn j 
661 = |yi + -^ye + ye + ^y« + ye — yr — y y® 


•ye- 


V3 


2 yio — yii’ 


V3 

6^2 = -y(yi + ys — y* — ye + yr + ys — yio — yii)» 

6^3 = yi — yj + ye — yy -t- ye — yn , 

664 = -y (yi — y2 + ye — ye + yr — ys -i- yio — yn), 

= gyi ^y^ + ye ^ye + ye — ^yr + -y ye — ye 

, v's 1 

n ' 


We could find the values of the o’s and Zi’s directly from these equations, 
but it would be a tedious process on account of the large number of terms 
in the right-hand members. We therefore reduce the number of terms 
on the right by grouping terms and substituting new variables for the 
different groups. The first grouping gives 


120o _ (yo -f ye) -f (yi y^) -f (y, y^,) -|- (y, y^) -}- _j. yg) 

+ (ys + yt), 
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Ga, = (y»— yi) + -^Cyi + yu) + + y«.) — |(y4 + y.) 

— + ?>)■ 

6fl, = (y, + y.) + i(yi + y,.) — |{y, + yi.) — (y. + y.) 

— -fCy* + y>) + -^(y. +yi). 

6a, = (y, — y«) — (y, + y,#) + (y. + y,). 

sa* = (yi> 4- y*) — ■|(yi + yiO — -|(yi + yi*) + (y* + y.) 
-|(y.+y.)--|(y. + y,>. 

ба, = (y, — y,) — -^(y, + y„> + |(y* + y..) — | Cy. + yO 

+ -^(yi 4- yr). 

I8a, S= (y, + y.) — (y, 4- y.i) 4- (y. 4- Sio) — (yi + y») 4- (y. + yi) 

— (y»4-yr). 

— ^(yi— yu) 4'^(y,— s..> 4- (y.— y*> 4- ^(yi— sO 
4-^<y»— yO. 

6(*i = -^[ (yi — yu) 4- (y. — y..) — (y. — yO — (y, — y,)], 

бб, = (yi — yu) — (yi — y.) 4- <yi — yt). 

Wo 

66,= -^C(y»— yu) — (Vi— y».) 4- (y»— y*) — (y»— y03. 

66, = ■|(y,— yu) —^(y*— y«) 4- (y» — y.) — ^(y4“y*) 

4- ■|(yi— yO 
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Let US now put 

Vo-jrV^ — ^0 

yi + yii = Ml 

y2 + yio = u. 

J/s + ^9 = M 3 

yt + ys =«* 

y= + yT =W5 


yo — ye — Vo 
yi — j/ii = vi 

VZ VlO = V2 

Vz — ya =Vo 
yt — ye =vt 
ye-y-t =vs. 


Then the normal equations become 

12ao = Mo + Ml + M 2 + Mj + Ml + Ms = (Mo + Ms) + (Mi + Us) + (Mj + “l)> 
6ai = Mo + = Mo + (Ml Mb) 

+ |(M2 — M,), 

GOj = Uo 4- -|mi — -|u 2 — Uj — -|u4 4- -ius = (Mo — Ms) 

+ -|(«l + Ms) — I (m? 4- Ml), 

Gus = Vo — Us 4- la, = Vo — - (Us — u«), 

60 i = Uo — -lui — ^Us 4 - Us — -|u« — -|u 5 = (Uo 4 - tis) — ■|(Ui 4 - Us) 
— -|(Us4-M«), 

c V3 , 1 1 , Vl", X 

Gas = Vo ^Ui 4- -Us — — Ui 4- -^Ms = Vo ^(Ui — Us) 

4- ■|(M2 — Ml), 

12aa = Uo — Ui 4- Us — Ms 4- U« Us = (Uo — Us) — (Ui + Us) 4- («2 4- Ml), 

+ Mg 4- -^M« 4- ^Vs = ^(Mi 4- Vs) 

\/3 

"1 ^ (Mj + M«) 4- Vi , 

65 j= .^(Vi 4 -Vs — Vg — Vs) = -^[(Vj — Vj) 4 - (t,j_v«)], 

66g =r t’l — Vg 4- Vx = (v, 4- Vs) — Vg , 
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S&4 

6ft. = ^ (fi — + V. — v.) =: — *’.} — (t'l — r.) J, 

66. = -|ti. — + t., — + -iir. = 2 (*'* + *’•) 

vT 

If we make the further sabstttntiona 

U, -{- Uj = r. «n — Bl = it •'» + ** = fi •'i — *•» — ?l 

Uj-j-Uj=:r, 11. — u, =«i + = t>* — V4=:q,, 

Bj -f. u, :s= r, B, — «4 = I, 

the normal equationa take the eimpler forms 

12a« s= f» + r. + ^* — *■« + (r» + r»)> 

Sa, = V, + -^a, + , 

6a, = a,+ — ^r, = j,+ |(r. — r,), 

6a|Sto — a, , 

ea. = r, — if, — if, s= »•*— |<*’i + r,), 

c Va _L 1 

6o. = v, 5-».+ 2**» 

12a, = 3, — r, 4- r, = a, — (r, — r,), 

6fti= ip,+ ^pi + ''. = *’.+ |pi + ^Pi, 

66* = ™ I?. + 9.). 

66j = p, — Vi, 

eft. = ™(9.-9.). 

66i = -Ipi — ^P* + «i = w. + -I?, — ^p* 
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Finally, we write 

Ti-\- Tz — l 

ri — ri = m 


?i + 92 — 9 

qi — 92 = 


Then the equations for finding the coefficients in the trigonometric series 
are 


( 174 . 2 ) 



The several substitutions made above can be accomplished very simply 
by the addition and subtraction scheme given below,* starting with the 
given 9*8. 


• Such Bchemes for computing the o’a and Vs were first devised by Runge about 
the year 1903. See Zeitschrift /fir Ifath. und Physik., XLVIII (1903), p. 443, and 
m (1905), p. 117. 
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j6C 

y. »» y* y» y* y* 

yi yti yio y» y« yr 

Sum Ua U| Wt t(a Ui Vi 

DiS! Vf Vi Vt Vi V4 Vi 

Ua U| Vt V| Vt 

Vx Ua Ui Vi Vi 

Sum r, r, Pi f, 

Dlff Ja »» 4 * Si 

Vi Si 

Fl ^ 

Sum 1 S 

Diff m A 

Tlw <)uantiti«s Va, v„ and r, ate printed in beaey type because they ate 
somewhat isolated from the othor quantities which appear is the iisal 
formulas for the eoefficienU 

CAeclb /ormttloe Since the chances of naVisg an mor is the additions 
and subtractions are considerable it is important to have a reliable check 
on the computed d’s and b’s As a check on the a’s we have from the first 
conditional equation 

ys = a« 4- a, + a, 4- a, + c, + 0, 0, 

To find a check for the b’s we subtract the twelfth conditional equation 
from the second, giving 

yi — yii = Aj 4" V 3Ai 4" V 36» d" » 

or, since 

*’i=yi— yji, 

V, = 6. 4- A, 4- 2A, 4- V3(6, 4- 6.) 

The check foimulas ate Iheiefote 

I (^ + s!) ’+ si. + vr(s. + 6.) = ». 

We shall now work an example to show the application of the above 
scheme 

Example I Find an empirical formula to fit the following data 
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X 0“ 30° 60° 90° 120° 150° 180° 210° 240° 270° 300° 330° 

y 9.3 15.0 17.4 23.0 37.0 31.0 15.3 4.0 - 8.0 -13.2 -14.2 - 6.0 


Solution. The first part of the computation is carried out according to 
the scheme given above and should be self-explanatory. 

0 1 2 S 16 


y’s 

9.3 

15.0 

17.4 

23.0 

37.0 31.0 


15.3 

— 6.0 

— 14.2 

— 13.2 

— 8.0 4.0 

Sum («) 

24.6 

9.0 

3.2 

9.8 

29.0 35.0 

Diff. (v) 

— 6.0 

21.0 

31.6 

36.2 

45.0 27.0 


0 

1 

2 


1 2 

v’e 

24.6 

9.0 

3.2 

v’s 

21.0 31.6 


9.8 

35.0 

29.0 


27.0 45.0 

Sum (r) 

34.4 

44.0 

32.2 

Sum (p) 

48.0 76.6 

Diff. (s) 

14.8 - 

-26.0 

25.8 

Diff. (g) 

— 6.0 —13.4 


r’s 

44.0 


— 6.0 




32.2 


— 13.4 



T 

= 76.2 

9 = 

— 19.4 



m 

= 11.8 

h — 

7.4 



Now substituting these quantities in equations (174.2), we get 
ao = ^(34.4-f 76.2) = 9.22, 

= I (— 6.0 — 26^ — 12 . 9 ) = - 6.90, 

02 = -1(14.8 + 5.9) = 3.45, 
o,= -|(— 6.0 + 26.8) =3.30, 

«♦= “•(34.4 — 38.1) = — 0.62, 

^ 6.0 + 26^ — 12.9^ = 0.60, 

^ (14.8 — 11,8) = 0.25, 
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I, = I (362 + 24 04- 66 3) =21 OS, 

6. = -^(-194)=-380, 

&, = |(480_362)=197, 

‘. = ^(»4) = ior. 

6, = I (36 2 + 24 0 — 66 3) = — 1 03 
Applying the check fopnvul»a (174 3), we hive 
2d = 930 = y», 

(6i + 6») + 26, + V3(i. + ^.) = 21 01 = v. 

The coefficients are therefore correct and the final formula js 
y s 9 22 — 6 90 cos I + 3 45 cos 2i + 3 30 cos 3f — 0 63 cos 4* 

+ 0 60 cos 5® + 0 25 coa 6* + 21 09 8ia s — S 80 am 2s 
+ 1 97 am 3s -r 1 07 sm 4s— 1 02 am 5s 
Nolt Since the terms of a trigonometric aenea are oidUtve, it u 
necessary that the coefficients all he computed to the same number of 
decsmal plocea (Art 7) 

175. Case of 24 Ordinates, For 24 equally spaced ordinates the Taluks 
of X are tsKcn at equal intervals of 15^ apart from 0° to 345* inclusive 
The appropriate formula for this case is 

(175 1) y = a» + aicoss + a,cos2s + «»cos3z + o,cos4s + a4co8 6s 
+ a, cos 6s + a, cos 7s + «• cos 6s + 0, cos 9z + Oi, cos lOz 
+ flj, cos Ils + o,,co3 l2s+ 5,8ins + 6, sm 2s -f 6, sm 3i 
+ 64 am 4s + 6, sin 5s + 5« sm 6z + 67 sin 7z + 6, sm 8s 
+ 6, sin 9s + 6,e8m 10s + 6„8m 11s 
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Let the corresponding values of x and y be as given in the table above. 
Then on substituting in (175.1) these corresponding values of x and y 
we get 24 conditional equations. Applying to these the rule for obtaining 
normal equations, we get 24 equations in which the a’s and b’s are given 
explicitly in terms of the y’s. Then we group the terms in the right-hand 
members, substitute new variables for the different groups, group again, 
etc., just as in the case of 12 ordinates. The final formulas for computing 
the o’s and Vs are found to be as follows: 


( 176 . 2 ) 


Oo — ■^(^0 + «)j 


“‘=^( 


Vo-l--SfSi — -~S2- 


V2®* 2®* + 


)• 

)• 


1 / « Vz 1 1 \ 

Ut - (^Vo — Ssi —s^ -1- -f -s, - (75, j , 

12 0““ — — ««) . 

1 Z' V 3 , 1 \ 

<Ho- s’"*)’ 

~ -55,) , 

~ 12 "2^* + ^P» + , 
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*‘ = M'” “ ~ • 

24 ’ 

*• = n + ’■) ’ 

i, = i (cp. - |p.- ip. + ^P. + «P. - p.) . 

l.= i(..-p. + i(p.+P.-p.)). 

b.. = -^ (sp. - |p. + :^p. - ^p. + Op. - . 

where C sees IS* = 0 9659258, ^ssem 15*:= 02586190, tfid tbe other 
quentrties are obtained from the given Jr’s according to tbe following 
aeheme 

y. y> y y» y* y» y* y» y» y* yi« yu 

yn y» y» y» yn y»» y>« yu y,% yn yi« yi» 

Sum Vg V| U] u, V, «j v« «T Ug 14 u,« Uu 

Difi rg Vi Vi F* V( V, Of vi Vg Vi« Vii 


«0 «1 « u» «4 «• Vi V* Vi v« V, 

«» «n V|« «t Mi V,, Vi« V, Vi V, 

Sum r, Ti r* fi f« r. Sum p, p, p, p^ p, 

DiS So s, Si S, St *t ViS 2, q, qt g, 

r, r, r, ?i y» 1, A, 

r, r, r, qt g, I, A, 

Sum It li h Sum 9\ 3t Sum e Sum c 

Diff m» m, m, Diff hi hi Diff f Diff <1 
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Here the quantities Vo, v^, and are printed in heavy type because 
they are somewhat isolated from tlie other quantities which appear in the 
final formulas for the coefficients. 

A check formula for the a’s is given by the first conditional equation, 
and is 

2 ® = 3/0 . 


To find a check formula for the b’s we subtract the 23d conditional 
equation from the second and obtain 

yi — j/23 = Vi = 2S{bi bii) + (bj + bm) + "f" ^o) 

-f- V3(&< ”h ^a) ~}~ 2C(b5 -{- bj) -j- 2bs . 

The check formulas are therefore 


( 175 . 3 ) 


2a = 3/o , _ _ 

- 2S (bi -f- bii) -f- (bj -f- bio) ~}- V 2 (bo -}~ bg') -}■ V3 (b^ -f- bg) 
-1- 2C (bj bj) 2bg t:::: Ui . 


Example 2. Find an empirical formula to fit tire data in the following 
table ; 


X 

0" 

IS” 

30° 

45° 

60° 

75° 

90° 

105° 

120° 

135° 1 

i 

150° 

165° 

O 

O 

00 

y 

149 

137 

128 

126 

128 

135 

1 

159 

178 

189 

191 


187 

178 


X 

195° 

210° 

225° j 

240° 

255° 

270° 

285° 

300° 

315° 

! 330° 

345° 

y 

170 

177 

183 

j 181 

1 179 

179 

[ 185 

182 

176 

166 

160 


Solution. The preliminary quantities are found by the scheme below; 

0 1 2 3 4 6 6789 10 11 

y’s 149 137 128 126 128 135 159 178 189 101 189 187 

178 160 166 176 182 185 179 179 181 183 177 170 

Sum (u) 327 297 294 302 310 320 338 357 370 374 366 357 

Diff. (u) — 29 — 23 — 38 — 50 — 54 —50 — 20 — 1 8 8 12 17 

0 1 2 3 4 6 

u’s 327 297 294 302 310 320 

338 3.57 366 374 370 357 

Sum (r) 665 654 660 676 680 677 

Diff. (s) — 11 — 60 — 72 — 72 — 60 — 37 



lIAItMOMC \N\USIs OF EMHRIC\L FLNCTIONS [Chaf XIX 


* 4 ( 

-50 —54 —50 
8 8—1 
-42 —46 —51 
-fiS —62 —49 

1 t 

q’s — 40 — 50 

— 49 —62 

Sum ( 7 ) —89 —112 

Dill (h) 9 12 

h’s 9 
12 

e=:2671 css 21 

/=— 9 <i = — 3 

>iOw kubstitutiug the«« quantities lo (175 2), we find 

а, =s 167 167, a. = — 19 983, o, = — 3 410, o, = 5 471, 

0«s= — 1 292, a, s 5:0 2'*0, fl« = 0 750 0, =s 0 309, 

#, = 0458, «, = — 0301 «„ = — 0090, o„:= — 0243, 

a„ = — 0083 

6j = — 12 779, 6, = — 16 625 5, = — 0323, 6, = 1 516, 

5, = 1 462, 5« = — 2 583 5, = 0 322 b, = — 0 216, 

б, = 0 677, 5,0 = — 0 459, 5„= — 0 640 

The check formulas (175 3) gire 

2a = 149 000 = y, , 

25(5. i 6.,) + (b, + b..) + \n(b, + 5.) + V3(6. + b,) + 2C(b, + b,) 
-f 2b, = — 22 997 = », , 

practicallj 

Hence the required formula is 

y = 167 167 — 19 983 cos* — 3 410 cos 2z 4- 5 471 cos 3r 

— 1 292 cos 4* 4- 0 250 cos 5* 4- 0 750 cos 6r 4- 0 309 cos 7* 

4- 0 458 cos 8x — 0 304 cos 9x — 0 090 cos 10* — Q2‘l3<mllx 

— 0 083 cos 12* — 12 779 Bin X — 16 625 sm 2x — 0 323 sin 3* 
4- 1 516 sm 4x 4- 1 462 sin 5x — 2 S83 sin 61 4- 0 323 sm 7x 

— 0 21 6 sm 8x 4- 0 677 sm 9x — 0 459 sin lOx — 0 640 sm llx 


vs —23 —38 

17 12 

Sum (p) — 6 —26 

Diff (9) —40 —50 

0 1 t 

r’s 665 654 660 

676 677 680 

Sum (0 1341 1331 1340 

Diff (m) —11 —23 —20 

1 8 1331 
1340 



Art. 176] 


PERIODS OTHER THAN 2t 


573 


176. Periods other than 2«. When a function is periodic and has a 
period different from 2Tr, vre change the independent variable by a linear 
substitution. Thus, if x is the independent variable and the given func- 
tion is y = / (a:), we write 

(1) s = 


If the limits for x are y and h and we wish the limits of 6 to be 0 and 
2ff, we have only to substitute in (1) these corresponding values of 
X and 6 and then solve the resulting equations for Ic and m. Hence in 
this case we have from (1) 

y = fc-fO, or = 
and 


7i = fc -}- 2i:m = y + 5iirm. 


Hence m = (Jn. — g) /2Tr, and the desired formula of transformation is 

,„e.U + 0. « = 

In all these cases the proper formula to assume for y is 
(176. 2) y = Oo + Oi cos 6 4- a^cos 20 -f • • • -f- 0 ,, cos nO 

bi sin 6 bj sin 20 -j- ’ ‘ ‘4“ ^n-i sin (n — 1)0. 

Tor example, if the period of a phenomenon is known to be 18.3 days 
and we wish to use 12 equidistant ordinates, the values of x corresponding 
to these ordinates would be Xo = 0, a:, = 18.3/12 = 1.525, Xj = 3.060, etc. 
The corresponding values of 0 would be 0", 30°, 60°, etc. The values of 
the a’s and b’s in (176.2) would be found in substituting in (176.2) 
these values of 0 and the corresponding y’s, or simply applying the 12- 
ordinate scheme to the given y’s. The resulting formula in terms of x 
would then be, by (176.1) and (176.2), 


(2) y = av4-aaCOS^^^^^4-a,cos2^^^^4.- • • 

+ + ■ ■ ■ ■ 

Example. The equation of time for twelve equidistant intervals in a 
certain year is given in the following table. Taking the period of this 
phenomenon to be 365.2 days, find an empirical formula that will give its 
value at any instant in that year. 



IlMiMOMC tMPIKlCAL FUNCTIONS [Chap \IX 


Partial Solution Here the value of u 3^^ solution of the 

problem is simplified by reducing the given values of y to seconds of time 
We then have the following table 


el 0* 1 30“ 1 60* 1 90* 1 120* 1 

150* 1 


y 1 190 9 1 810 4 1 740 6 | 233 6 | —183 7 

1—142 6 I 



1 18Q* 1 810° I 240** \ 270* \ 3QQ* | 330* ( 
I mo I 5500 I 93 I —6138 | —9782 ] —6596 | 


Treating the ya according to the scheme of Art 174 and substituting 
the results into eijuations (174 3), we find 

ao = 1499, a. = — 4733, tf,s=212 95, o, = 5 53, a«sr — 6 83, 
a>s26 2$, a. = — 14 68 

6, =43031, b, = 36 34, 6,= — 1167. 6, = 587 94 l>, = — 14 35 
The required formula u therefore 

, = 14 99 - 47 32 ». (|^\) + 212 93 ». 2 

+ 26 2Cco,3(|^) -1468^,6(1^) 

^ ^ 

+ 58794..„4(|^)_143G™5(3^), 

where y is in seconds of lime 

The render should note that when the Bucce<sive values of x are sub 


'lituted into the results are 30*, 60“, etc Thus, 

_ 365 3 /2rt:, \ 2w 

12 V365 2 / ~ 365 2 



EXKKCISE!^ 


01 u 


Art. 17C ] 


Caution in the Use of Empirical Formulas. Empirical formulas are 
really interpolation formulas of particular forms, and are therefore sub- 
ject to all the limitations of interpolation formulas. They can he relied 
upon for all values of the independent variable within the range of values 
used in determining the coefficients, hut should not be trusted outside of 
these limits, except possibly for very short distances outside the range of 
values used. Stated otherwise, empirical formulas may be used for inter- 
polation but not for extrapolation. 

If, however, the given function is known to have a certain form for all 
values of the independent variable, we may use the formula for computing 
rough values of the function outside the range of values used in deter- 
mining the coefficients. 


EXERCISES XX 

1. Find a periodic function that will fit the following data; 


X 

0 ° 

30 ° 

60 ° 

90 ° j 

O 

O 

150 ° 

180 ° 

o 

O 

240 ° 

270 ° 

300 ° 

330 ° 

D 



4.3 



- 18.1 


- 27.2 

- 23.8 

8.2 

31.7 

34.2 


2. Do the same for the following; 


X 

0 ° j 

15 ° 

o 

o 

45 ° 

60 “ 

75 ° 

90 ° 

105 ° 

120 ° 

135 ° 

150 ° 

165 ° 

180 ° 

y 

45 

110 

142 

128 

138 

88 

-2 

-12 

-25 

-39 

-21 

-38 

-69 


195 ° 

O 

O 

225 ° 

o 

O 

255 ° 

270 ° 

1 285 ° 

j 300 ° 

j 315 ° 

330 ° 

345 ° 

-78 

-90 

-112 

-92 

-70 

-45 

25 

i 

68 

59 

1 

40 

54 


3. Solve completely the Example of Art. lie. 

4. The period of a certain phenomenon is 14.4 days. Twenty-four 
values for equal time intervals are given below. Find an empirical formula 
to represent this phenomenon. 

2.4, 5.6, 6.7,, 7.4, 8.8, 9.9, 10.4, 12.0, 13.8, 14.9, 16.4, 16.8, 17.5, 
18.4, 19.2, 20.8, 21.4, 20.5, 18.5, 16.0, 15.1, 14.8, 12.2, 6.4. 































































APPENDIX 

VALUES OF THE PROBABILITY INTEGRAL 


P - ^ e* Vl wfiere t - 

Ax 

0 123456789 

0 00 

0 01 

0 02 

0 OJ 

0 04 

0 00000 0QU3 00226 00339 004S1 00564 00677 00790 00903 01016 

0 01128 01241 01354 01467 01580 01692 01805 01918 02031 02144 

0 02256 02369 02482 02S9S 02708 02820 02933 01046 03159 03271 

0 03384 03497 03610 03722 03835 03948 04060 04173 04286 04398 

0 04511 04624 04756 04849 04962 05074 05187 05299 05412 0S525 

0 05 

0 06 

0 07 

0 OS 

0 09 

0 05637 05750 05862 05975 06087 06200 06512 06425 06557 06650 

0 06762 06875 06987 07099 07212 07524 07457 07549 07661 07775 

0 07886 07998 QSliO 08225 08335 08447 08559 08671 08784 08896 

0 09008 09120 09232 09344 094S6 09368 09680 09792 09904 10016 

0 10128 10240 10352 10464 10576 10687 10799 10911 11023 11135 

0 10 

0 n 

0 U 

0 u 

0 14 

0 11246 11358 11470 11581 11693 11805 11916 12028 12139 17251 

0 12362 12474 12585 12697 12808 12919 13031 13142 13253 15365 

0 13476 13S87 13698 15809 13921 14032 14143 14254 U56S 14476 

0 14587 14698 14809 14919 15050 15I4I 15252 15563 15475 15584 

0 15695 ISSOS 15916 16027 16157 16248 16358 16468 16579 16689 

0 15 

0 16 

0 17 

0 18 

0 19 

0 16800 16910 17070 17130 17241 17351 17461 17571 17681 17791 

0 17901 18021 iat:i 18751 18541 18451 18560 18670 IS780 18890 

0 18999 I9I09 19218 19528 19437 19547 19636 19766 1987S 19984 

0 20094 20203 205U 20421 20530 20639 20748 70857 20966 21075 

0 21184 21293 21497 21510 21619 21728 21836 21945 22055 22162 

0 20 

0 21 

0 71 

0 25 

0 24 

0 22270 22579 27487 22595 22704 22812 22920 23028 25136 23244 

0 25552 25460 23568 23676 25784 25891 25999 24107 24214 24322 

0 24450 24557 24645 24752 24859 24967 25074 25181 2S288 25595 

0 25502 25609 25716 25825 2$9V) 26057 26144 26230 26357 26463 

0 26570 26677 267W 26889 26996 27102 27208 27314 27421 27527 

0 25 

C 36 

0 27 

0 28 

0 29 

0 27633 27759 J784S 279SO 28056 28162 28268 28573 28479 28584 

0 23690 3339S 28901 29006 29111 29217 29522 2942? 29352 2965? 

0 29742 29847 29932 300S6 30161 30268 30370 30475 SQS79 30684 

0 30788 30892 30997 51101 51205 31309 31413 31517 3l62l 31725 

0 51828 31922 52036 32139 52243 32346 32450 32353 32656 32760 

0 30 

0 31 

0 32 

0 35 

0 34 

0 32863 32966 35069 55172 33275 33578 33480 33585 33686 35788 

0 33891 33993 34096 34198 34300 34403 34505 34607 34709 34811 

0 34913 33014 33116 35218 35319 35421 35523 33624 35725 35827 

0 35928 460 9 56130 36251 56532 36453 36554 56635 36755 56836 

0 36936 37037 37137 37238 37338 37438 37538 37638 37738 37838 

0 35 

0 36 

0 37 

0 38 

0 39 

0 37938 38038 38138 38237 38337 38436 38536 38635 38735 38834 

0 38933 39037 39J31 39230 39329 39428 39526 39625 39724 39822 

0 39921 40019 40117 40215 40314 40412 40510 40608 40705 40803 

0 40901 40999 41096 41194 41291 41388 41486 41583 41680 41777 

0 41874 4W71 42068 42164 41261 42358 42454 42550 42647 41743 

0 40 

0 41 

0 42 

0 43 

0 44 

0 42839 42935 43031 43127 43223 43319 4341S 43510 43606 43701 

0 43797 43892 43988 44083 44178 44273 44368 44463 44557 44652 

0 44747 44841 44936 45030 45124 45219 45313 45407 45501 4SS9S 

0 45689 45782 45876 45970 46063 461S7 46250 46343 46436 46529 

0 46623 46715 46808 46901 46994 47086 47179 47271 47364 47456 

0 45 

0 46 

0 47 

0 48 

0 49 

0 47S48 47640 47732 47824 47916 48008 48100 48191 48283 48374 

0 48466 48SS7 48648 48739 48830 48921 49012 49103 49193 49284 

0 49375 49465 49555 49646 49736 49826 49916 50006 50096 50185 

0 50275 50365 50454 50543 30633 50722 50811 50900 50989 51078 

0 31167 S12S6 Sl34< 31433 51321 51609 Si698 51786 SI874 51962 



VALUES OF THE PROBAIMLITY INTEORAL 


577 


2 r * 

F = —p. f where I = hx. 

Vsr •'0 


0 1 2 3 4 5 6 


0.52050 52138 52226 52313 52401 52488 52576 52663 52750 52837 
0.52924 53011 53098 53185 53272 53358 53445 53531 53617 53704 
0.53790 53876 53962 54048 54134 54219 54305 54390 54476 54561 
0.54646 54732 54817 54902 54987 55071 55156 55241 55325 55410 
0.55494 55578 55662 55746 55830 55914 55998 56082 56165 56249 

0.56332 56416 56499 56582 56665 56748 56831 56914 56996 57079 
0.57162 57244 57326 57409 57491 57573 57655 57737 57818 57900 
0.57982 58063 58144 58226 58307 58388 58469 58550 58631 58712 
0.58792 58873 58953 59034 59114 59194 59274 59354 59434 59514 
0.59594 59673 59753 59832 59912 59991 60070 60149 60228 60307 

0.60386 60464 60543 60621 60700 60778 60856 60934 61012 61090 
0.61168 61246 61323 61401 61478 61556 61633 61710 61787 61864 
0.61941 62018 62095 62171 62248 62324 62400 62477 62553 62629 
0.62705 62780 62856 62932 63007 63083 63158 63233 63309 63384 
0.63459 63533 63608 63683 63757 63832 63906 63981 64055 64129 

0.64203 64277 64351 64424 64498 64572 64645 64718 64791 64865 
0.64938 6S0I1 65083 65156 65229 65301 65374 65446 65519 65591 
0.65663 65735 65807 65878 65950 66022 66093 66165 66236 66307 
0.66378 66449 66520 66591 66662 66732 66803 66873 66944 67014 
0.67084 67154 67224 67294 67364 67433 67503 67572 67642 67711 

0.67780 67849 67918 67987 68056 68125 68193 68262 68330 68398 
0.68467 68535 68603 68671 68738 68806 68874 68941 69009 69076 
0.69143 69210 69278 69344 69411 69478 69S45'6961i 69678 69744 
0.69810 69877 69943 70009 70075 70140 70206 70272 70337 70403 
0.70468 70533 70598 70663 70728 70793 70858 70922 70987 71051 

0.71116 71180 71244 71308 71372 71436 71500 71563 71627 71690 
0.71754 71817 71880 71943 72006 72069 72132 72195 72257 72320 
0.72382 72444 72507 72569 72631 72693 72755 72816 72878 72940 

^3368 73429 73489 73550 
0.73610 73671 73731 73791 73851 73911 73971 74031 74091 74151 


0.74210 74270 74329 74388 74447 74506 
0.74800 74859 74917 74976 75034 75092 
0.75381 75439 75496 75553 75611 75668 
0.75952 76009 76066 76122 76178 76234 
0.76514 76570 76626 76681 76736 76792 


74565 74624 74683 74742 
75150 75208 75266 75323 
75725 75782 75839 75896 
76291 76347 76403 76459 
76847 76902 76957 77012 


0.77067 77122 77176 77231 77285 77340 77394 77448 77502 77556 

78038 78091 
‘^8512 78565 78617 

0.78669 iSiZl 787i3 /8824 78876 78928 78979 79031 79082 79135 
0.79184 79235 79286 79337 79388 79439 79489 79?S 79SW 7?M1 


0.79691 

0.80188 

0.80677 

0.81156 

0.81627 

0.82089 

0.82542 

0.82987 

0.83423 

0.S3SS1 


79741 79791 79841 79891 79941 79990 80040 80090 80139 

S072S 80773 80^77 Inafn ®®580 80628 

81204 »?7Q0 810^1 81109 

oli04 0 I 25 I 81299 81346 81393 81440 814S7 R1^^4 

81674 81720 81767 81813 81859 81905 81951 81997 82043 


82135 82180 82226 82271 82317 82362 

P3nf( f ^2766 82810 
S3031 83075 83119 83162 83206 83250 
83466 83509 83552 83595 83638 83681 
83893 83935 83977 84020 84061 84103 


82407 82452 82497 
82855 82899 82943 
83293 83337 83380 
83723 83766 83808 
84145 84187 84229 




%ALtFS OP THE PROB4BIUTV INTEGRAL 


0 S4270 S4312 &43S3 84394 8443S 84477 84S18 84339 84600 84640 

0 84681 84722 84762 84803 84843 84883 84924 84964 85004 83044 

0 85084 83124 83163 83203 83243 83282 85322 85361 85400 83439 

0 85478 85517 85556 85S9S 8563* 85673 85711 85750 85788 85827 

0 85865 85903 85941 85979 86017 86035 86993 86131 86169 86206 

0 86244 86281 86318 86336 86393 86430 86467 86304 86541 86S7S 

0 86614 86651 86088 86724 86760 86797 86833 86869 8690S 86941 

0 86977 87013 87019 87083 87120 8tlS6 87191 87227 87262 87297 

Q 87333 87368 87403 87438 87473 87fi)7 87S42 87377 87611 87646 : 

0 87680 87713 87749 87783 87817 87831 87885 87919 87953 87987 

0 88021 8S034 8S08S 88121 88155 88188 88221 88234 88287 88370 

0 88333 88386 88419 88452 88484 88SI7 88549 88582 8S614 88647 

0 88679 88711 88743 88773 88807 88839 88871 88902 88934 88966 

I 0 88997 89029 89060 89091 89122 89134 89ISS 89216 89247 89277 

I 0 89308 89339 89370 89400 89431 89461 89492 89522 89352 89582 . 

0 89612 89612 89672 89702 89732 89762 89792 89821 89851 89880 I 

0 89910 89939 89968 89997 90027 90036 90083 90114 90142 90171 

, 0 9Q2Q0 90229 90237 90286 90314 90343 90371 90399 90428 90436 I 

0 90484 90512 90340 90368 90393 90623 90651 90678 90706 90743 

! 0 90761 90788 9081$ 90843 90870 90897 90924 90931 90978 91003 

0 91031 91038 91083 91111 91138 91164 91191 91217 91243 91269 

0 91296 91322 91348 91374 91399 91425 91451 9 U77 91502 91528 

I 0 91333 91579 91604 91630 916SS 91680 91703 91730 91735 91780 

' <3 91803 91830 91833 9(879 91904 91929 91933 91978 92002 92026 

0 92031 92073 92099 92123 92147 92171 92193 92219 92243 92266 

0 92290 92314 92337 92361 92384 97408 92431 92454 92477 92500 

, 0 92324 92547 92320 92393 92613 92638 92661 92684 92706 92729 

0 92731 92774 92796 92819 92841 92863 92883 92907 92929 92931 

j 0 92973 92995 93017 93039 93061 93082 93104 93126 93147 93168 

0 93190 93211 93232 93234 9J27« 93296 93317 93338 93359 93380 

0 93401 93422 93442 93463 93484 93304 93323 93345 93366 93386 

0 93606 93627 93647 93667 93687 93707 93727 93747 93767 93787 

0 93807 93826 93846 93866 93885 93905 93924 93944 93963 93982 

0 94002 94021 94040 94039 94078 94097 94116 94133 94154 94173 

0 94191 94210 94229 94247 94266 94284 94303 94321 94340 94338 

0 94376 94394 94413 94431 94449 94467 94483 94303 94521 94538 

0 94356 94374 94592 94609 94627 94644 94662 94679 94697 94714 

0 94731 94748 94766 94783 94800 94817 94834 94831 94868 94885 

0 94902 94918 94933 94932 94968 94983 95002 93018 95033 93031 

0 9'067 93084 93100 95116 93132 93148 95163 95181 93197 93213 

0 95229 93244 93260 93276 95292 93307 95323 95339 93334 95370 

0 93383 93401 95*16 93431 93447 93462 95477 95492 95507 93323 

0 9SS38 9S3S3 95568 95582 95397 93612 93627 95642 956S6 93671 

I 0 95686 95700 9S71S 95729 957« 9S138 95775 95787 95801 95815 

j 0 95830 95844 95858 93872 93886 93900 95914 95928 95942 95956 

0 95970 95983 95997 WOll 96024 96038 96051 96065 96078 96092 

0 96105 96119 96132 96145 96139 96'72 96185 96198 96211 96224 

0 96237 96230 96263 96276 96289 96302 9631S 96327 96340 96333 

0 96363 96378 96391 96405 96416 96428 96440 96453 96465 96178 

0 96490 96502 96514 96526 96539 96351 96563 96S7S 96587 96599 



VALUES OF THE PROBABILITY INTEGRAL 

2 r* 

P = — = I where t = hx. 

y/rJi 


1.50 0.96611 96634 96658 96681 96705 

1.51 0.9672S 96751 96774 96796 96819 

1.52 0.96841 96864 96886 96908 96930 

1.53 0.96952 96973 96995 97016 97037 

1.54 0.97059 97080 97100 97121 97142 | 

1.55 0.97162 97183 97203 97223 97243 

1.56 0.9726.3 97283 97302 97322 97341 

1.57 0.97360 97379 97398 97417 97436 

1.58 0.97455 97473 97492 97510 97528 

1.59 0.97546 97564 97582 97600 97617 

0.97635 97652 97670 97687 97704 
0.97721 97738 97754 97771 97787 
0.97804 97820 97836 97852 97868 
0.97884 97900 97916 97931 97947 
0.97962 97977 97993 98008 98023 

0.98038 98052 98067 98082 98096 
0.98110 98125 98139 98153 98167 
0.98181 98195 98209 98222 98236 
0.98249 98263 98276 98289 98302 
0.98315 98328 98341 98354 98366 

0.98379 98392 98404 98416 98429 
0.98441 98453 98465 98477 98489 
0.98500 9SSI2 98524 98535 98546 
0.98558 98569 98580 98591 98602 
0.98613 98624 98635 98646 98657 


0.98667 98678 98688 
0.98719 98729 98739 
0.98769 98779 98789 
0.98817 98827 98836 
0.98864 98873 98882 

0.98909 98918 98927 
0.98952 98961 98969 
0.98994 99003 99011 
0.99035 99043 99050 
0.99074 99081 99089 


98699 98709 
98749 98759 
98798 98808 
98846 98855 
98891 98900 

98935 98944 
98978 98986 
99019 99027 
99058 99066 
99096 99104 


0.99111 99118 
0.99147 99154 
0.99182 99189 
0.99216 99222 
0.99248 99254 

0.99279 99285 
0.99309 99315 
0.99338 99343 
0.99366 99371 
0.99392 99397 

0.99418 99423 
0.99443 99447 
0.99466 99471 
0.99489 99494 
0.99511 99515 
0.99532 99536 


99126 99133 99140 
99161 99168 99175 
99196 99202 99209 
99229 99235 99242 
99261 99267 99273 

99291 99297 99303 
99321 99326 99332 
99349 99355 99360 
99376 99382 99387 
99403 99408 99413 


0.99532 99536 99540 99544 99548 
0.99552 99556 99560 99564 99568 
0.99572 99576 99580 99583 99587 
0.99591 99594 99598 99601 99605 
0.99609 99612 99616 99619 99622 
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A 

Absolute error, 4 

Acceleration of gravity, formula for, 42 
Accidental errors, 454 
Accuracv in determination of arguments, 
28 ■ 

in evaluation of formulas, 24 
of addition, 10 
of averages, 11, 12 
of division, 15, 1C 
of interpolation formulas, 102 
of linear interpolation, 112 
of logs and antilogs, 19 
of measurements, 487 
of multiplication, 14 
of powers and roots, 18 
of products and quotients, 14, 15, 1C, 17 
of series approximations, 32 
of subtraction, 12. 13, 14 
of solution of difference equations, 399, 
400 

of differential equations, 301 
of systems of linear equations, 301 
Adams, J. C., 321, 325 
Addition^ errors of, 10 
Adopted values of constants, 25 
Algebraic equations, special procedure 
for, 205 

Alternating series, error in, 34 
Analysis, harmonic, of empirical func- 
tions, 558 

Antilogarithnis, accuracy of, 19, 20 
Approximate numbers, 2 
Arguments, accuracv in determination of, 
28 

Astronomy, practical, fundamental equa- 
tions, of, 43, 44 
Asymptotic series, 104, 409 
Average deviation, 493 
error, 490 

Averages, accuracy of, 1 1 
method of, 522 

B 

Backward interpolation, Xeicton’s form- 
ula for, 59 


Ballistic equations, 307, 308, 309 
Ballistics, fundamental equation of, 307 
Bairstow, L., 251 
Barker, J. E., 370 
Barker method, 370, 377 
how to use, 373 
Bashforth, F., 321 

Bessel's formula of interpolation, 84, 85 
for interpolating to halves, 85 
symmetrical form of, 85 
when to use, 89 

Best type of empirical formula, finding, 
548 

Biermann, 0., 54, 122 
Binomial series, remainder in, 35 
Block relaxation, 410 
Borel, E., 102 

Boundary-value problems, 432, 444 
Bradle 3 ', J., 485 
Brodetsky, S., 243 

C 

Cajori, F., 199 
Carvallo, 257 

Caution in use of empirical formulas, 575 
in use of quadrature formulas, 16G 
Central-difference formulas, 
of interpolation, 79 
quadrature, 143, 146 

geometric significance of, 146 
remainder terms in, 187 
Charlier, C. V. L., 163, 165, 191 
Chauvenet, IV., 469 

Check formula for coefficients in root- 
squared equations, 231 
Check formulas, for 12 ordinates, 566 
for 24 ordinates, 571 

Combination of sets of measurements 
497, 498 

Complex root.s, detection of, 232 
computation of, bv Graeffe’s method 
232 " ■ ’ 

Conditional equations, 558, 559 
Conditions for convergence of iteration 
irrocess for algebraic and transcen- 
dental equations, 210, 221, 299 
of Picard’s method, 350 
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Conformal tran«form3tion, 401 
Constant*, adopted values of, 25 
Convergence, conditions for, 

in iteration process, 210, 221, 209 
in Picard s method, 350 
Cramer, Gabriel, 204 
Cramer’s rule, 204, 266 
Cntenon for negligible effects, SOS 
Curve, Gaussian 462 
Cubature, mcehanical, 170 
formula for, 171 

general statement concerning, 472 

n 

Davids, Norman, 154 
Denvatives, nth, 38 

Derivatives and differences, relation be- 
tneen, 54 

Detection of complex roots, 232 
Determinants, 
errors in, 39 
evaluation of numerical, 
by expansion m minors, 258 
by pivotal method, 259 
by triangular method, 261 
tnangular, 261 


Deviation, average, 493 
standard, 493 



quotients, 386 
table, diagonal, 48, 50 
horizontal, 49, 50 
Differences, 48 

and derivatives, relations between, 54 

central, 79 

double, 121 

of a polynomial, 54 

tno-nay, 121, 122 

Differential equations, ordinary, nuroen 
cal solution of, 

by difference polynomials, 318 
by Euler s method 308 
by Milne's method, 3S1 
by Picard s method, 314 
by Runge-Kutta method, 356 
by St5rmer method, 342 
partial, numerical solution of, 
by iteration, 390 
by relaxation, 404 
by Rajleigh Ritz method, 416 


starling the solution of, 

I ulcr method W) 
b% Milne s formulas, 128 
bv Iluiigc-Kiitta method, 357 
In Tailor <ene* method 326 
Uiffcrenliatinn niimcn'al, 13-3 
partial of tabiihled function*, I IS 
Direet mevilrement*, 487 
Ihvufed differences definition of, Co 
relalion to simple differences, 68 
synunetri of, 67 
laMea of, CG 

Division, accurac} of, 15 
Double differences, 121 
general formula for, 122 
D^ble interpolation, 

b) repeated single interpolation 114 
formula for, 124 
remainder term of, 124 
E 

Elliptic integrals, 30 
Emmons, H R , 416 
Fmpmcal formulas, 516 
caution in use of, 575 
finding t>e«t t\ pe of, 548 
finding constants in, 
hi method of averages, 522 
111 metbod ol least squares, 527 
bi plotting, 516 

when both variables are subject to 
enor, 545 

when residuils ate weighted 636 
general ease of non linear formulas, 539 
Pneke J F 270 
Equal effects method of, 507 
pnnciple of, 26 

Equatums, algebraic and transcendental, 
103 

location of roots of, 192 193 
solution of, 

by interpolation, 105 
by Iteration, 206, 217 
bv Newton Raphson method, 190, 213 
bj repented plotting on larger scale, 
197 

Equation* ballistic, 367 360 
differenre, 388 
differential, ordinary, 308 
of catenof balli«1ics, 367 369 
of first order, 308-334 
of second order, 335-346 
special, of second order, 340-346 
simultaneous, 346-348 
partial, 385-430 
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Equations, error, -162 
functional, 460 
heat conduction, 389 
integral, 431-453 
linear, 439-443 
non-linear, 444-453 
Laplace, 388 

linear systems, accuracy of solution of, 
301 

normal, 529 
Poisson, 389 
probability, 462 
residual, 528 

simultaneous linear, 258-307 
accuracy of solution of, 301-305 
numerical solution of, 
by determinants, 264-267 
by method of division by leading 
cocffuMcnts, 267-269 
by Gauss’s method, 270-275 
by inversion of matrices, 294-295 
by iteration, 295-298 
Error, average, 490 
effect of, in tabular value, 52 
equation, 462 
function, 458 

inhenmt in Gauss’s quadrature for- 
mula, 189 

in Simpson’s Rule, 181 
in Weddle’s Rule, 187 
in solution of difference equations, 
399 

mean square, 489 
probable, 489 

Errors, general formula for, 9 
in addition, 10 
in determinants, 39 
in division, 15 
in logarithms, 19 
in muKiplication, 14 
in powers and roots, 18 
in solution of differential equations. 
361 

in solution of simultaneous linear 
equations, 301 
in subtraction, 12 
percentage, 4 

probability of, between given limits, 
456 

propagation of, 505 
relative, 4 
.\ystcmatic, 454 

Euler’s metliod of solving differential 
equations numerically, 308 , 

mo<liried, 310, 369 


Euler’s quadrature formula, 163 
inherent error in, 190 
remainder term in, 190 
Euler’s summation formula, 164 
Evaluation of determinants, 258 
of formulas, accuracy in, 24 
the two problems in, 24 
of probability integral, 467 
Exponential series, remainder in, 35, 36 

F 

False position, method of, 195 
Figures, significant, 2 
Finding best type of empirical formula, 
548 

Formulas, check, 566, 571 
empirical, 516 
Milne, 352 

non-linear empirical, 539 
Forward interpolation, formula for, 58 
Function, error, 458 
Green’s, 434 
table, 114 

Functional equation, 460 
Fundamental equation for errors in argu- 
ments, 29 

of exterior ballistics, 367 
G 

Cans, R., 385 

Gauss, C. F., 132, 150, 270 ' 

Gaussian curve, 462 
Gauss’s interpolation formrdas, 79-81 
backward formula, 80 
forward formula, 79 _ 
third formula, 81 

Gauss’s method of solving simultaneous 
linear equations', 270-275 — 
quadmture formula, 150 — 
disadvantages of, 157 
inherent error in, 189 
Geometric significance’ of t 
central-difference quadrature formulas, 
146 

Newton-Raphson method, 201, 202 
precision measures, 491 
Simpson’s Rule, 138 
Weddle’s Rule, 139 
Weierstrass’s theorems, 47 
Geometry of iteration, 208 
Goursat, E., 432, 444 
Goursat-Hedrick, 175 
Graeffe, 223 
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Gracffe’s root equinng method, 223 Newton’* general formula of, 70 


for complex roots, 232 
for equal roots, 241 

Brodctskj and Smeal s improvement of 
243 

extension Oi, by Carvallo, 257 
improving the accuracy of, 255 
for real roots, 226 
principle of 223 

Rainbov.’8 ehtcV on eoeffitienla m, 230 
Graphic method of determining constant* 
m empirical formulas 516 
of solving equations, 192 
Gravitj, formula for acceleration of, 42 
Gregory, J , 53 
Green's function, 434 
Grouping of equations, 524 

n 

Halves, formula for interpolatrng to, 85 
Halving the interval, 333 
Hactnooic walyeia of empineal fuoe* 
tioos, 558 

Heat-conduetiOD equation, 389 
Uermite’s formula, 130 
Horuontal dJTerenee table, 49 
I 

Index of precision for errors, 462 
for residuals, 482 
Indirect measurements, 487 
the two fundamental problem* of, 507 
Inherent error in Gauss's quadrature 
formula, 189 

in Newton-Raphson method, 204 
in pnsmoidal formula, 178 
in Simpson’s Rule, 181 
in solution of partial differential equa< 
tions by difference equations, 399 
in \t eddle's Rule, 187 
Integral equations, 315, 431 
linear, 439 
non linear, 444 
Integrals, elliptic, 30 
Integrating ahead, formula for, 319 
Integration, numerical See Numerical 
integration 

Interpolation, definition of, 46 
accuracy of, 102 
backftaTd, foimula IcpT, 89 i 
Bessel’s formulas for, 84, 85 
forward, formula for, 56 
double, 114 130 
inverse, 93 

Lagrange’s formula for, 74 


emes 102 

to halves, formula for, 85 
tngonometne, formula for, 130 
Interval halving the, of h, 332 
Inverse Sntcrpolatiepn, 93 
by Lagrange’s formula, 93 
by reversion of senes, 96 
by successive approximations, 93 
Iteration, method of, for finding roots, 
206, 217 , 

for solving difierence equations, 390 > 
for solving integral equations, 315, 431 
for solving systems of linear equations, 
295 

process for algebraic and transcen- 
dental equations, 206, 217,-449 
convergence of, 209, 219, 299 
rule for, 300 
geometry of, 208 

and relaxation methods compared, 414, 
415 

J 

Jahnke and Emde, 30 
K 

Kernel of integral equation, 431 
Kooy, J M J , 373 
Kutla, W . 357 

L 

Lagrange’s formula of interpolation, 74 
remainder terra in, 103, 104, 108 
uses of, 75 
Lattice points, 386 
Law of accidental errors, 454 
Law of error of a function, 462, 466 
for residuals 481 

Least squares method of, 527, 537 
principle of, 475, 478 
Levmson, A , 154 
Ltebmann, H , 385 

Linear equations, solution of simultan- 
eous algebraic, 258-307 
accuracy of solutions of, 301 
function, law of error of, 462, 466 
integral equations 439 
interpolation, accuracy of, 112 
with several arguments, 124 
Lobatto, 157, 190 
Lobatto a quadrature formula, 157 
ai^hcation of in solution of integral 
equations, 447 
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Logarithmic series, remainder in, 37 
paper, 519, 521, 549 
Logarithms, accuracv of, 19 
Lovett, W. V., 444 
Lon'an, A. N., 154 
Ltiroth, J., 32 

Maclaurin’s series, remainder term in, 33 
Malmsten's formula, 190 
Matrices; addition and subtraction of, 276 
column, 276 
inversion of, 2S2-295 
multiplication of, 277 
by a number or scalar, 277 
by another matrix, 278-281 
unscrambling of, 288, 291-293 
unit, 276 

Matrix, definition of, 275 
of coefficients, 278 
inverse, 282 
non-singular, 282 

Maxima and minima of tabulated func- 
tions, 134 

Mean, weighted, 479 
Mean square error, 488 
Measurements, direct, 487 
indirect, 487 
rejection of, 513 
Measures of precision, 488 
computation of, from residuals, 494-497 
geometric significance of, 491 
relations between, 490 
Mechanical quadrature, definition of, 136 
Mechanical cubature, 136, 170 
general rule for, 172 
Membrane, vibrating, 424 
Method of averages, 522 
of Barker for starting trajectories, 370 
of equal effects, 507 
of Euler, 308 
of false position, 195 
of Graeffe, 223 

of interpolation, for finding roots, 195 
of iteration for finding roots, 206, 217, 
295 

for solving difference equations, 390 
for solving simultaneous linear equa- 
tions, 295 

of least squares, 527, 537 
of Milne, for solving differential equa- 
tions, 351 

of Picard, for solving differential equa- 
tions, 314 


of relaxation, 404 
of Runge and Kutta, 357 
of selected points for finding constants 
in empirical formulas, 516 
pivotal, of evaluating determinants, 259 
Rayleigh-Ritz, 416 

Stormer-AIilne, for special second-order 
equations, 342 

triangular, of evaluating determinants, 
261 

Methods of solving partial differential 
equations, 385-430 

of solving simultaneous linear equa- 
tions, 258-300 

of starting solutions of differential equa- 
tions, 326, 327, 369 
Miller, F. H., 417 
Milne, \V. E., 327, 351 
Milne’s method for solvdng differential 
equations, 351 

formulas for starting the solution of a 
differential equation, 328 
formulas for solving differential equa- 
tions, 352 
Mistakes, 454 

Modulus of complex roots, theorem re- 
lating to, 239 
Montel, P., 102 
Moors, B. P., 154, 190 
Moulton, F. R., 325, 369 
Multiplication, accuracy of, 14 

N 

Negligible effects, criterion for, 508 
Networks, triangular, 409 
Newton, I., 199 

Newton-Raphson method of solving equa- 
tions, 199 

convergence of, 210 
for simultaneous equations, 213 
geometric significance of, 201 
inherent error in, 203 
Newton’s formula (II) for backward 
interpolation, 59 
(I) for forward interpolation, 56 
Non-linear empirical formulas, 539 
integral equations, 444 
Normal equations, 529, 537 
rule for writing down, 529, 537 
Normal probability curve, 456, 462 
A'th derivatives, table of, 38 
Numbers, approximate, 2 
rounded, 2 

Numerical differentiation, 133 
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Kumencaf inleeralion, 136-180 
by centwJ-differenre quadrature lonuu* 
Us, 143, 146 
by Euler’s formula, 163 
bj Gauss's formula, 151 
bj Lobitto’s formula, 358 
by Sjxopson’s Rule, 137 
by Tchtbjcheff s formula, 160 
b\ Wsddle’a Rule, 138 
Numerioii solution of ordinary 

equations, advantages and 
'anlagi’s of, 364 

b> approximating polj noimals, 3|g 
JxvJliil^r^.in.,thni) JlftS 
by Milne’s method, SSI 
by Jbeard’s method, 314 
by Runge-Kutti rnelhod, 357 
starting the, 326, 3G3 
.Vumeneal solution of partial 
equition®, 
b> Iteration, 300 
bv relaxation, 404 
by Tla\leigh-Uitt method, 4(6 
Niitrom, E J , 432 

0 

Obstnaliont, rejection of, 513 
uiighteJ, 476 
Overreluatioii, 400 

P 

Palmer, A ili. F , 2o, SOS, 500 
i’artnl »}invatjve» of t-tlmbled 
tioiia, IdS 
Pearson, K , 130 
Percentage error, 4 
protiahle error, 506 
Periods other than 2r, 573 
Picard, method, 314 
Pivotal ell merit, 25'J 
eqii ition, 267, 270 

method of eviliiating deleTjn,„^f. 
250-2SI 

Plotting, method of repeated, 197 
Point’, lattice, 386 
method of selected, 516 
Poisson’s equation, 38!> 

Polynomial, diflerenccs of a, 54 

when nth diftprences ate constanj^ 550 
I'biJ'innmail; ityptifximiixlirgTd^t^ 

Pope, Alexander, 4f) 

Postmultiplication and premoltiplic^t^ 
of rnatnees, 281 

Powers and roots, accuracy of, I8 


PrseCiea! astronomy, fundamental equa- 
tions of, 43-44 

Precision and arcuraey, distinction lie- 
tvroen, 487 
index for errors, 462 
for residuals, 432 
measures, 4$S 

computation of, from residuals, 494, 
495 

georaetnc significance of, 493 
relations between, 490 
Pnneiple of equal effects, 26 
of Craeffe's method, 2^ 

<r/ Usri -^7^, -t'S 

Prismatoid, definition of, 177 
Pnsjtund, definition of, 175 
PnsBiiHdal formula, 176 
Pnsmoids and prismatoids, distinction 
between, 177 

Probability equation, for errors, 462 
for residuals, 482 
curve, normal, 456 
integral, evaluation of, 467 
tables of, 576 

of error* lying between given limits 
456 

of hitting a target, 470 
Probable error, computation of, n;pm 
residuals. 494 
definition of, 439 
formulas for, 494, 497, 505, 506 
in indirect measurementa, 505, 506 
meaning of, 503 

of anthmriie and weighted mean*, 494 
of a function whose re’s are known, 

Prob^le error and weight, relation be- 
tween, 493, 494 
Probable percentage error, 506 
relative error, 505 506 
I’eoduct, accuracy of, 14 
relative error of, 14 
Propagation of errore, 505 

Q 

Quadrature, mechanical, 136 
fornulas, caution m use of, 166 
central difference, 143, 146 
Euler’s, 163 
Gauss’s, 160 

geiieraf, for equidistant ordinates, f^ff 
Lobatto’s, >58 
Simpson’s, 137 
TehebycheH’s, 160 
tleddle's, I3S 
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